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Students in the Russian Federation and Singapore Had the Highest 
Reading Achievement 


Fifty countries from around the world participated in the PIRLS 2016 international assessment 

of reading comprehension at the fourth grade, and in every country there was a wide range of 

reading achievement from basic skills to advanced comprehension. The fourth grade students in 

the Russian Federation and Singapore had the highest reading achievement on average. These two 
countries also had more than one-fourth of their students reaching the PIRLS Advanced International 
Benchmark. Students reaching this level interpreted, integrated, and evaluated story plots and 
information in relatively complex texts. Hong Kong SAR, Ireland, Finland, Poland, and Northern Ireland 
also performed very well, with approximately one-fifth of their students reaching the Advanced 
Benchmark. 


Russian Federation Singapore 
Hong Kong SAR 2) Ireland 2) Finland 66 | 
Poland Northern Ireland == 


In terms of basic reading literacy, it is noteworthy that in more than half of the PIRLS 2016 countries 


almost all of the students (more than 95 percent) demonstrated fundamental reading skills. These 
students could locate and reproduce ideas and information from text and make straightforward 


inferences. 
PIRLS 2016 Trends Indicate an Increase in Good Readers Internationally 
PIRLS countries with both There are internationally more good readers than 
long term and short term gains there were 15 years ago. The trends over time since the 
: : inception of PIRLS in 2001 show more increases than 
e Hungary e Russian Federation decreases in achievement. Eleven countries improved 
e Italy e Slovenia over the long term (2001 to 2016) and only 2 declined; 
18 improved over the short term (2011 to 2016), 

e Norway 


compared to 10 declining. 


More Girls Than Boys Are Good Readers 


Girls had higher average achievement than boys in 48 of the 50 PIRLS 
2016 countries, and boys did not have higher achievement in any 
countries. The gender gap in reading achievement has favored girls 
since 2001 and does not appear to be closing. 
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Good Readers Have Home Environments That Support Literacy Learning 


aT Pe TT Across countries, higher reading achievement was related to: 
HIN 


e More home resources that support learning (books in the home, 
study supports, and educated parents with professional/technical 
occupations) 


e More digital devices in the home 


e Parents who like to read 
As amatter of some concern, there was a decrease in parents’ positive attitudes toward reading since 


2011 in 31 countries, and only 2 countries had an increase. On average in 2016, only 32 percent of 
the students’ parents liked to read alot and 17 percent reported they did not like to read. 


Good Readers Had an Early Start in Literacy Learning 


PIRLS indicates two basic ways students get an early start in literacy learning: 


e Having parents who often engage them in early literacy activities 
e Attending preprimary education 


®® 


Parents are students’ first teachers, and 39 percent of the students had 
parents who reported often engaging their children in early literacy 
activities such as reading, talking, or singing to them as well as telling them 


aha’ 


stories and teaching them to write alphabet letters. These students had higher reading achievement 
than students whose parents engaged them less frequently in early literacy activities. 


According to their parents, 59 percent of the PIRLS students had attended 3 years or more of 
preprimary school. There was a positive relationship between the number of years that students had 
attended preprimary school and higher reading achievement. 


According to their parents—whether through parental encouragement of early literacy learning, 
attending preprimary education, or both—29 percent of the students were able to perform early 
literacy tasks very well when they began primary school. These students had higher reading 
achievement in the fourth grade than their classmates who started school with only moderate literacy 
skills or few skills. On a positive note, trends showed increases in 16 countries and only 1 decrease 
compared to 2011 in students’ time spent on early literacy activities. 


Good Readers Attended Well Resourced, Academically Oriented Schools 


Across the countries, students had higher reading achievement on average if they attended schools: 


e With more affluent than economically disadvantaged students 

e Where a higher proportion of their peers had early reading and 
writing skills when entering first grade 

e Where instruction was not affected by reading resource shortages 
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Interestingly, principals and teachers were in agreement about whether 
their schools emphasized academic success. On average, 8 percent of the 
students attended schools with very high emphasis, 54 to 55 percent were 
in schools with high emphasis, and 37 to 38 percent were in schools with 


medium emphasis. Higher reading achievement was associated with a higher 
degree of emphasis on academic success. 


fv 
a 
| @ | 


It also is worth mentioning that almost all fourth grade students reported a 
positive sense of school belonging, and a higher sense of school belonging 
was related to higher average reading achievement. 


Good Readers Attended Safe Schools 


Internationally, the majority of fourth grade students were in safe school environments, but those 
attending schools with a disorderly environment had much lower reading achievement than their 
counterparts. Results also showed: 


of the students were in schools where the principals 
reported hardly any discipline problems, and 8 percent 
were in schools with moderate to severe problems 


of the students were in schools that teachers found 
very safe and orderly, and 3 percent were in schools 
that teachers found less than safe and orderly 


of the students reported never or almost never being 
bullied, and 14 percent reported being bullied 
about weekly 


Reading Instruction Was a High Priority in Primary Schools Internationally 


On average, 27 percent of the available instructional time is devoted to language instruction, and 
18 percent is devoted specifically to reading instruction. Also, for the most part, students have well 
qualified teachers and principals. Reading instruction often involves access to libraries and at least 
weekly computer-based activities. 


Good Readers Attend School Regularly and Are Not Tired or Hungry 


Despite the generally positive school climates, according 

to teachers and students themselves, some students are 

suffering from a lack of adequate nutrition or sleep and 

some frequently are absent. For example, 26 percent of the 
students said they were hungry every day or almost every 
day and 15 percent said they were absent at least once every 
two weeks. Students with these attributes had lower reading 
achievement than their classmates. 
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Good Readers Had Positive Attitudes Toward Reading 


The fourth grade students were very positive about reading and their reading instruction. Positive 
attitudes were associated with higher reading achievement. Considerable research indicates that 
positive attitudes toward reading and high achievement are related, and in a bidirectional way—that is, 
better readers may enjoy reading more and, thus, read more often than poorer readers. This can lead 
to better development of reading comprehension skills and strategies. Results also showed: 


of students were very or somewhat engaged 
in their reading instruction 


liked reading very much or at least somewhat 


were very or somewhat confident in reading 


The generally positive attitudes represent good news. However, it is alarming that already by the 
fourth grade about one-fifth of the students were not confident about their own reading abilities. 


Good Readers Had Little Difficulty Reading Online 


PIRLS 2016 included the ePIRLS assessment of online 
reading for countries where students are familiar with 
using computers and the Internet to conduct research 
for school projects. ePIRLS is a computer-based 
assessment that uses an engaging, simulated Internet 
environment to present the fourth grade students with 
authentic school-like assignments involving science and 
social studies topics. For examples of the ePIRLS tasks, 
please see Take the ePIRLS Assessment. 


© 


Students in the 14 countries who participated in ePIRLS reported a high degree of self-efficacy in 
computer use, and demonstrated that they were able to navigate to the appropriate webpages, 
completing the assessment in the allotted time. 


The Singaporean fourth grade students had the highest ePIRLS achievement, but all participants 
proved to be good to excellent readers on ePIRLS. On average, 50 percent of the students reached the 
High International Benchmark, demonstrating the ability to integrate information across webpages 
and interactive features and evaluate how graphic elements support content. 
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About PIRLS 2016 


Overview 


PIRLS (Progress in International Reading Literacy Study) was inaugurated in 2001 as a follow-up 
to IEA’s 1991 Reading Literacy Study. Conducted every five years, PIRLS assesses the reading 
achievement of young students in their fourth year of schooling—an important transition point in 
their development as readers. Typically, by this time in their schooling, students have learned how 
to read and are now reading to learn. PIRLS is designed to complement IEA’s TIMSS assessment of 
mathematics and science at the fourth grade. 

TIMSS and PIRLS are directed by IEAs TIMSS & PIRLS International Study Center at Boston 
College in close cooperation with IEA Amsterdam, IEA Hamburg, and Statistics Canada. IEA is an 
independent international cooperative of national research institutions and government agencies 
that pioneered international assessments of student achievement in the 1960s to gain a deeper 
understanding of policy effects across countries’ different systems. IEA has been conducting 
international assessments of reading literacy and the factors associated with proficient reading 
comprehension in countries around the world for about 60 years. 


PIRLS 2016 


PIRLS 2016 is the fourth assessment in the current trend series, following PIRLS 2001, 2006, and 
2011. There were 61 participants in PIRLS 2016, including 50 countries and 11 benchmarking entities 
(e.g., regions of countries as well as additional grades or language groups from the participating 
countries) that were assessed to provide comparative data to inform policy. For countries that have 
participated in a previous assessment since 2001, the PIRLS 2016 results provide an opportunity 
to evaluate progress in reading achievement across four time points: 2001, 2006, 2011, and 2016. 
The PIRLS 2016 assessment is based on the PIRLS 2016 Assessment Framework developed 
collaboratively with the participating countries. The framework is organized around two overarching 
purposes for reading—for literary experience and to acquire and use information. Four reading 
comprehension processes are integrated across the purposes: focus on and retrieve explicitly stated 
information, make straightforward inferences, interpret and integrate ideas and information, and 


evaluate and critique content and textual elements. 
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Nationally representative samples of approximately 4,000 students from 150 to 200 schools 
participated in PIRLS 2016. About 319,000 students, 310,000 parents, 16,000 teachers, and 12,000 
schools participated in total. 

All of the countries, institutions, and agencies involved in successive PIRLS assessments have 
worked collaboratively to improve PIRLS and build the most comprehensive and innovative measure 
of reading comprehension available for comparing achievement globally across countries. Depending 
on its educational development and students’ reading level, a country can choose to participate in 
PIRLS Literacy (which includes some less difficult passages and items) and have its results reported 
on the PIRLS achievement scale and directly comparable to PIRLS. Both the PIRLS and PIRLS 
Literacy assessments are based on 12 passages (6 literary and 6 informational) and approximately 
180 items. 

As its most innovative development, PIRLS 2016 saw the debut of ePIRLS—a computer-based 
assessment of online reading. Designed to be responsive to the information age, ePIRLS provides 
important data about how well students are developing 21* century online reading skills. The ePIRLS 
results are presented in conjunction with the PIRLS 2016 results in ePIRLS 2016 International Results 
in Online Informational Reading. 

The goal of PIRLS is to provide the best policy-relevant information about how to improve 
teaching and learning and to help young students become accomplished and self-sufficient readers. 
PIRLS always has included school, teacher, and student questionnaires as well as the Learning to 
Read Survey completed by students’ parents or caregivers. The PIRLS 2016 questionnaire results 
provide a wealth of information about the home, school, and classroom contexts in which students 
learn to read. 

As a qualitative companion to the quantitative reports produced to summarize the international 
achievement and questionnaire results, each PIRLS assessment has been accompanied by an 
encyclopedia comprising chapters written by each participating country or benchmarking entity 
describing its reading curriculum and instruction. The chapters are published together with 
the results of the PIRLS Curriculum Questionnaire completed by each participant to provide 
comparative information across countries. With contributions from the 61 participants, the PIRLS 
2016 Encyclopedia provides a comprehensive view of reading education around the world. 


Quality Assurance 


PIRLS 2016 made every effort to attend to the quality and comparability of the data through 
careful planning and documentation, cooperation among participating countries, standardized 
procedures, and rigorous attention to quality control throughout. The assessments were administered 
to nationally representative and well-documented probability samples of students in each country. 
Staff from Statistics Canada and IEA Hamburg worked with National Research Coordinators on all 
phases of sampling activities to ensure compliance with sampling and participation requirements, 
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with good success even taking into account the few exceptions annotated in the data exhibits. IEA 
Amsterdam worked with the TIMSS & PIRLS International Study Center to manage an extensive 
series of verification checks to ensure the comparability across countries of translations of the PIRLS 
passages, items, and questionnaires, and to conduct an international quality assurance program of 
school visits to monitor and report on the administration of the assessment. IEA Hamburg worked 


closely with National Research Coordinators to organize data collection operations and to check all 
data for accuracy and consistency within and across countries. 


PIRLS 2016 Results 


The international results for PIRLS 2016 are published through a report website and the results for 
ePIRLS 2016 also can be accessed from there. 

The PIRLS 2016 International Results in Reading includes 10 chapters or sections providing 
overviews in the form of infographics and numerous exhibits summarizing student achievement 
distributions, performance at the PIRLS International Benchmarks, achievement trends over time, 
and achievement in relation to students’ home, school, and classroom educational contexts for 
learning to read. The exhibits can be downloaded and printed from the Download Center. 


The website includes links to: 


e PIRLS 2016 Assessment Framework, 2" Edition describes in some detail the overarching 
reading purposes and the reading comprehension processes to be assessed as well as the 
framework describing the types of learning situations and factors that were to be investigated 
via the questionnaire data. There also is an overview of the assessment design. 


e PIRLS 2016 Encyclopedia: Educational Policy and Curriculum in Reading describes national 
contexts for reading instruction and learning. It contains data about educational structure 
and organization in the participating PIRLS countries together with a chapter written 


by each participant summarizing the countries’ reading curricula in the primary grades, 
instructional approaches, teacher education requirements, and the types of examinations 
and assessments employed. 


e Methods and Procedures in PIRLS 2016 describes the methods and procedures used to 
develop, implement, and analyze the results from the PIRLS 2016 international assessment. 


e PIRLS 2016 International Database is available to all individuals interested in analyzing the 
data collected as part of PIRLS 2016. The database includes student reading achievement 
data as well as the student, parent, teacher, school, and curricular background data for the 
PIRLS countries and benchmarking entities. 


e Context Questionnaires provide complete text of the PIRLS 2016 questionnaires completed 
by students and their parents, teachers, and school principals, as well as the Curriculum 
Questionnaire completed by National Research Coordinators to provide information on the 
national and community contexts for learning. 
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Exhibit 1: Countries Participating in PIRLS 2016 
Exhibit 1 shows the PIRLS 2016 countries and benchmarking participants. Altogether there were 61 
participants in the PIRLS 2016 assessments, including 50 countries and 11 benchmarking entities. 


Some education systems within countries have always participated separately throughout IEA’s long 
history (e.g., the French- and the Dutch-speaking parts of Belgium, Hong Kong SAR). 
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Exhibit 1: Countries Participating in PIRLS 2016 


Australia 
Austria 
Azerbaijan 
Bahrain 

Belgium (Flemish) 
Belgium (French) 
Bulgaria 

Canada 

Chile 

Chinese Taipei 
Czech Republic 
Denmark 

Egypt 

England 

Finland 

France 

Georgia 
Germany 

Hong Kong SAR 
Hungary 

Iran, Islamic Rep. of 
Ireland 

Israel 

Italy 

Kazakhstan 


Kuwait Benchmarking 
Latvia Participants 
Lithuania Buenos Aires, Argentina 


Macao SAR Ontario, Canada 
Malta Quebec, Canada 
Morocco Denmark (3) 
Netherlands Norway (4) 


New Zealand 
Northern Ireland Eng/Afr/Zulu - RSA (5) 
Andalusia, Spain 
Oman Madrid, Spain 

Poland Abu Dhabi, UAE 


Portugal Dubai, UAE 
Qatar 

Russian Federation 

Saudi Arabia 

Singapore 

Slovak Republic 


Norway (5) 


Slovenia 

South Africa 

Spain 

Sweden 

Trinidad and Tobago 
United Arab Emirates 
United States 


Note: Norway chose to assess the fifth grade to obtain better comparisons with Sweden and Finland but also collected benchmark data at 
the fourth grade to maintain previous trends. The Republic of South Africa (RSA) benchmarked at the fifth grade with schools where students 


have instruction in English, Afrikaans, or Zulu. 
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Exhibit 2: Grade Assessed and Average Age of the Students Assessed in 
PIRLS 2016 
Exhibit 2 provides the years of schooling and the average age of the students assessed for each 
participant. The PIRLS target population is the grade that represents four years of schooling, 
counting from the first year of ISCED Level 1.! Level 1 corresponds to primary education or the 
first stage of basic education, with the first year of Level 1 marking “systematic apprenticeship of 
reading, writing and mathematics.” However, IEA has a policy that children should be at least 9 years 
old before being asked to participate in a paper-and-pencil assessment such as PIRLS. Thus, as a 
policy, PIRLS also tries to ensure that, at the time of testing, students do not fall below the minimum 
average age of 9.5 years old. For example, England, Malta, and New Zealand assessed students in 
their fifth year of school to meet this requirement. To better interpret the average ages of students, 
Exhibit 2 also includes information about the countries’ policies regarding age of entry into primary 
school and how that tends to work in practice. If students start school at a comparatively older age, 
they will be comparatively older when they are assessed by PIRLS. 


1 ISCED stands for the International Standard Classification of Education developed by the UNESCO Institute for Statistics. UNESCO Institute for Statistics 
(2012). International standard classification of education: ISCED 2011. Montreal, Canada. 
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Country 


Australia 


Austria 


Azerbaijan 


Bahrain 


Belgium (Flemish) 


Belgium (French) 


Bulgaria 


Canada 


Chile 


Chinese Taipei 


Czech Republic 


Denmark 


Egypt 


England 


Finland 


of Formal 
Schooling* 


Year 4 


Grade 4 


Grade 4 


Grade 4 


Grade 4 


Grade 4 


Grade 4 


Grade 4 


Grade 4 


Grade 4 


Grade 4 


Grade 4 


Grade 4 


Year 5 


Grade 4 


A dash (-) indicates comparable data not available. 
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Exhibit 2: Grade Assessed and Average Age of the Students Assessed in 
PIRLS 2016 


National Research Coordinators' Reports, except average ages are from PIRLS 2016 data 


Country's Name | Average 
for Fourth Year 


Age at 
Time of 
Testing 


10.0 


10.3 


10.1 


g9) 


10.1 


10.0 


10.8 


19) 


10.1 


10.1 


10.3 


10.8 


10.0 


10.3 


10.8 


* The PIRLS target population is the grade that represents four years of schooling counting from the first year of ISCED Level 1. However, IEA has a policy that students do not fall 
under the minimum average age of 9.5 years old at the time of testing, so England, Malta, and New Zealand assessed students in their fifth year of formal schooling. 
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of Entry to Primary School in Practice 


Information About Policy on Students’ Age 
of Entry to Primary School 


Varies by state, but generally children must begin school Most children begin school when they are 4.5-5 years old, 

but some wait until the compulsory age, either on advice 
from preschool staff or on the judgment of parents, usually 
because of maturity. It is not usual for children to skip the 
Foundation year and go straight to Year 1, although this is 

Children must begin school in the September following Parents can request earlier admission to school for mature 


children who will turn 6 by March 1 of the following 


Children must be 6 years old by September 15 to begin 
school the following September. Students with birthdays 
between September 16 and December 31 can qualify to 
begin school the following September by taking an 


Children typically begin primary school at age 7 because 
their parents feel they will benefit from being more 


SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 


Children begin school in the calendar year of their 6th 


Children begin school in September of the calendar year of Parents can decide to enroll children at the age of 5, with 
approval of the class council, or at age 7. 

Parents can extend preschool by one year or enroll 
students in primary school one year early after consulting 
with the Centre for Psychological, Medical, and Social 
Services and the head of the school. 


Children begin school during the calendar year of their 6th 


Children begin school during the calendar year of their 7th Children may begin school at the age of 6 at the discretion 
of parents or guardians. 

Varies by province, but some parental discretion is typically 
allowed. Some parents opt to enroll children one year later 


or earlier and others choose to homeschool their children. 


Varies by province, but most children begin school 
between ages 5 and 7. 

Children must be 6 years old by March 31 of the year they Principals are allowed some discretion in admitting 
children who turn 6 after March 31 but before June 30. 
Parents can apply for early enrollment to elementary 
schools. Legal representatives can apply to delay 
enrollment to elementary schools for children with 


Children must be 6 years old in order to begin school in 


Children must be 6 years old to begin school in September. On one hand, parents may request that children born after 
September 1 may be allowed to enroll at age 5 with 
pedagogical and psychological certification. On the other 
hand, about 22% of students every year receive permission 
to postpone enrollment for one year. 

Children begin preprimary education in August during the 


calendar year of their 6th birthday. 


Parents may request early enrollment for children whose 
5th birthdays are before October 1. Parents may also 
request a one-year postponement of enrollment. Early 
enrollment decisions are typically made based on 
recommendations from the kindergarten or a qualification 


Children must be 6 years old by the end of September in 
order to begin school in October. 


Children typically begin primary school at age 7 because 
their parents feel they will benefit from being more 


Local authorities must provide a place from September for 
all children turning 5 in that year. Children are required to 
start primary school (reception class) in the September 
following their 4th birthday. 


Subject to parental discretion, a child can start school later 
in the school year or in September after the child's 5th 
birthday if the child was born in the summer (April 1 to 
August 31) and if parents think their child is not ready yet 
to start in the September after the child's 4th birthday. 
Children begin school in August during the calendar year of It is possible for parents to enroll children one year earlier 
or one year later than the official policy due to 
psychological or medical reasons. 


Country 


France 


Georgia 


Germany 


Hong Kong SAR 


Hungary 


Iran, Islamic Rep. of 


Ireland 


Israel 


Italy 


Kazakhstan 


Kuwait 


Latvia 


Lithuania 


Macao SAR 
Malta 


Morocco 


Netherlands 


New Zealand 


Northern Ireland 


Country's Name | Average 
for Fourth Year 


of Formal 
Schooling* 


Grade 4 


Grade 4 


Grade 4 


Primary 4 


Grade 4 


Grade 4 


Fourth Class 


Grade 4 


Grade 4 


Grade 4 


Primary Grade 4 


Grade 4 


Grade 4 


Primary 4 
Year 5 


Grade 4 


Grade 6 


Year 5 


Year 6 
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Age at 
Time of 
Testing 


9.8 


9.7 


10.3 


28) 


10.6 


10.2 


10.0 


10.9 


10.8 


10.0 


9.7 


10.2 


10.1 


10.1 


10.4 


Exhibit 2: Grade Assessed and Average Age of the Students Assessed in 
PIRLS 2016 (Continued) 


Information About Policy on Students' Age 
of Entry to Primary School 


Children must begin school in the calendar year of their 6th 
birthday. 

Children must be 6 years old by the beginning of the 
academic year in order to begin school. 

Varies by state, but generally children must have reached 
their 6th birthday before a statutory qualifying date 
(between June 30 and September 30) in order to begin 
school on August 1. 

Children must reach the age of 5.75 years before 
September 1 in order to begin school that year. 

Children must be 6 years old by August 31 in order to begin 
school that year. 


Children must be 6 years old by September 21 (the 
beginning of the school year) in order to begin school. 
Children must begin school between the ages of 4 and 6. 


Children begin school in the calendar year of their 6th 
birthday. 


Children begin primary school during the calendar year of 
their 6th birthday. 


Children begin school when they are 6 or 7 years old. 


Children must be 6 years old by March 31 in order to begin 
school that year. 

Children begin school during the calendar year of their 7th 
birthday. 


Children begin school during the calendar year of their 7th 
birthday. 


Children begin school during the calendar year of their 6th 
birthday. 

Children begin primary school during the calendar year of 
their 5th birthday. 

Children begin primary school at age 6. In remote areas, 
the age of entry may be 5.5 years. 

Children must begin kindergarten on the first school day of 
the month after their 5th birthday. 


Children must attend primary school from their 6th 
birthday, but they have the right to be enrolled in school 
from age 5. 

Children who reach the age of 4 between September 1 and 
July 1 must begin compulsory education the following 
September. 


Information About Students’ Age 
of Entry to Primary School in Practice 


In rare cases, parents can request early or delayed 
enrollment. 

Official policy does not allow for early admission. However, 
there are no regulations on late admission. 

Varies by state, but generally, parents may apply to the 
local primary school for deferred enrollment for children 
with demonstrated physical or mental disabilities. 


For parents who have a particular school in mind, they can 
apply for a discretionary place. 

Children may remain in preschool for an additional year. 
Parents may request early entry for mature students. These 
decisions are made on the basis of a recommendation from 
a committee of experts. 

Some private schools require children to be 7 years old 
before beginning primary school. 

Although not obliged to attend school until the age of 6, 
most children begin preprimary school in the September 
following their 4th birthday. 

Parents may apply for delayed enrollment. The request is 
discussed by the kindergarten teacher, an educational 
psychologist, and the parents, and the parents have the 
final say in enrollment decisions. 

Children begin primary school during the calendar year of 
their 6th birthday. Parents have discretion over early 
enrollment. 


Most children begin school at age 7. 


Follows policy 


Parents can request early or delayed enrollment 
depending on the state of health and psychological 
preparedness of the child. 

Parents can request enrollment for children at the age of 6. 
Children's mental and physical maturity is determined by 
the municipal pedagogical psychological services. Parents 
may also request delayed enrollment. 


Follows policy 

Follows policy 

Follows policy 

Most children begin kindergarten when they turn 4. Most 
children are 6 years old when they enter primary education 
(ISCED 1). 

In general, children begin school on or soon after their 5th 


birthday. 


Follows policy 
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Exhibit 2: Grade Assessed and Average Age of the Students Assessed in 
PIRLS 2016 (Continued) 


Country 


Norway (5) 


Oman 


Poland 


Portugal 


Qatar 


Russian Federation 


Saudi Arabia 


Singapore 


Slovak Republic 


Slovenia 


South Africa 


Spain 


Sweden 


Trinidad and Tobago 


United Arab Emirates 


United States 


Country's Name | Average 
for Fourth Year 


Age at 
Time of 
Testing 


of Formal 
Schooling* 


Grade 5 10.8 
Grade 4 97 
Primary 4 10.7 
Grade 4 98 


Grade 5 for English 
curriculum schools; 


Grade 4 for other ws 
schools 
Grade 4 10.8 
Grade 4 99 
Grade 4 10.4 
Grade 4 10.4 
Grade 4 9.9 
Grade 4 10.6 
Grade 4 9.9 
Grade 4 10.7 


Standard 3 10.2 


Grade 4 98 


Grade 4 10.1 


Information About Policy on Students’ Age 
of Entry to Primary School 


Children begin school during the calendar year of their 6th In rare cases, parents can request earlier (if born before 


birthday. 


Children must be at least 5.75 at the beginning of 
September to join Grade 1 in public schools, or 5.25 years 
to join Grade 1 in private schools. 


year (mid-September) to begin school that calendar year. 


Information About Students’ Age 
of Entry to Primary School in Practice 


April 1) or delayed enrollment. The decisions are made on 
the basis of recommendations from kindergarten and the 
municipal pedagogical psychological services. 

To enroll in grade 1, students must be between 5.75 and 


6.75 years old. Otherwise, students are registered in above 


grades according to age with a special treatment plan by 
the school. 


Children must be 6 years old by the beginning of the school Parents and guardians can request conditional enrollment 


for children who will turn 6 between mid-September and 
the end of the calendar year. 


Children must be 6 years old by the end of June in order to Although the official policy states that all students can 


begin school the following September. 


Children must be between the ages of 6.5 and 8 by the end Parents may request early enrollment with the consent of 


of August to begin school. 


Children must be 6 years old by the end of August to begin Often, children begin school when they are 5.75 years old. 


school the following September. 


enroll in school when they are 6 years old, some students 
enroll at age 7 because their parents believe they will 
benefit from being more mature. 


the school principal for children under 6.5 years of age. 
Parents have the right to send their children to school at 
age 7 or older if they want the child to be more mature or 
for health reasons. 


According to the Compulsory Education Act, children must Parents may seek a deferral of registration for medical 


begin school in the calendar year of their 7th birthday. 


reasons or if the child is homeschooled. 


Children must be 6 years old by August 31 in order to begin Enrollment may be delayed or advanced based on 


school in September, unless granted a postponement. 


Children begin school during the calendar year of their 6th 


birthday. 


Children must be 6 years old by June 30 to begin school 
that calendar year. Compulsory schooling begins at age 7. 


Children begin school during the calendar year of their 6th 


birthday. 

Children begin school in August in the calendar year of 
their 7th birthday. Most students begin the voluntary 
preschool class during the calendar year of their 6th 
birthday. 


Children begin school during the calendar year of their 5th 


birthday. 


Children begin school during the calendar year of their 6th 


birthday. 

Each state requires parents to send their children toa 
school between 5 and 8 years old, but the ages vary by 
state. 


psychological tests and professional recommendations. 


Enrollment may be delayed by no more than one year 
upon parents’ or doctors’ recommendations. The final 
decision is made by the head teacher at the 
recommendation of a committee (including counselors, 
school physicians, and teachers). 


Children are encouraged to begin at age 7 because schools 


and parents feel that they will benefit from being more 
mature. 
Follows policy 


Under special circumstances, the municipality may allow a 


child to delay enrollment for one year. Parents can also 
request enrollment during the year of a child's 6th 
birthday. 

Children may begin school at age 4 if they are to turn 5 
within the first term (September to December) of that 
year. 

Follows policy 


Children typically begin kindergarten at age 5. 


Norway chose to assess the fifth grade to obtain better comparisons with Sweden and Finland but also collected benchmark data at the fourth grade to maintain previous 


trends. 
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Country 


Benchmarking Participants 


Buenos Aires, Argentina 


Ontario, Canada 


Quebec, Canada 


Denmark (3) 


Norway (4) 


Moscow City, Russian Fed. 


Eng/Afr/Zulu - RSA (5) 


Andalusia, Spain 
Madrid, Spain 


Abu Dhabi, UAE 


Dubai, UAE 


of Formal 
Schooling* 


Grade 4 


Grade 4 


Grade 4 


Grade 3 


Grade 4 


Grade 4 


Grade 5 


Grade 4 


Grade 4 


Grade 4 


Grade 4; Year 5 for 
schools following 
UK curriculum 
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Exhibit 2: Grade Assessed and Average Age of the Students Assessed in 
PIRLS 2016 (Continued) 


Country's Name | Average 
for Fourth Year | Ageat 
Time of 


Testing 


10.0 


9.8 


10.1 


9.8 


9.8 


10.8 


11.6 


9.8 


9.9 


9.7 


9.9 


Information About Policy on Students’ Age 
of Entry to Primary School 


Information About Students’ Age 
of Entry to Primary School in Practice 


Children must be 6 years old before June 30 in order to 
begin school that calendar year. 

Students must begin school in September if they will turn 
6 on or before September 1. However, children have the 
right to attend school in September if they will turn 6 any 
time up until December 31 of that year. 


Parents may enroll their children prior to age 6, but this is 
not mandatory. Two years of kindergarten (ages 4 and 5) 
are not mandatory. In addition, some parents homeschool 


Children must reach the age of 6 before October 1 of the 
current school year. 

Children begin preprimary education in August during the 
calendar year of their 6th birthday. 


Parents may request early enrollment for children whose 
5th birthdays are before October 1. Parents may also 
request a one-year postponement of enrollment. Early 
enrollment decisions are typically made based on 
recommendations from the kindergarten or a qualification 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Children begin school during the calendar year of their 6th In rare cases, parents can request earlier (if born before 
April 1) or delayed enrollment. The decisions are made on 
the basis of recommendations from kindergarten and the 
municipal pedagogical psychological services. 

Children must be at least 6.5 years old but no older than 8 
years old by September 1 in order to begin school that 


September if they have no medical contraindications. 


Children typically begin primary school at age 7. Parents 
and principals have the right to advance or delay 


Children must be 6 years old by June 30 to begin school 
that calendar year. Compulsory schooling begins at age 7. 


Children are encouraged to begin at age 7 because schools 
and parents feel that they will benefit from being more 


Children begin school during the calendar year of their 6th 
Children begin school during the calendar year of their 6th 
Children begin school during the calendar year of their 6th 


Most parents prefer children start school as early as 


Children begin school during the calendar year of their 6th Follows policy 
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Exhibit 3: Percentages of Students Who Liked Reading the PIRLS Passages 
Exhibit 3 shows the percentages of students who liked reading the PIRLS passages. Including PIRLS 
and PIRLS Literacy, the 2016 assessment included 20 different passages, 8 only in PIRLS, 4 in both 
PIRLS and PIRLS Literacy, and 8 only in PIRLS Literacy. The students participating in PIRLS were 
positive about the PIRLS only passages (on average, 85% liked the passages a little or a lot). For 5 of 
the passages (4 of which were literary passages), girls were more positive than boys. Both the PIRLS 
and PIRLS Literacy students reported liking the 4 passages in both assessments (91% on average). 


The PIRLS Literacy students were the most positive, on average, with 95 percent liking the PIRLS 
Literacy passages. 
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Exhibit 3: Percentages of Students Who Liked Reading the PIRLS Passages 


Students’ Reports 


Passage 


PIRLS Passages 
Shiny Straw 88 (0.2) 90 (0.3) 87 (0.3) 
Macy and the Red Hen 86 (0.2) 89 (0.3) 83 (0.3) 
The Empty Pot 89 (0.2) 93 (0.2) 86 (0.3) 
Oliver and the Griffin 86 (0.2) 89 (0.3) 83 (0.3) 
Leonardo Da Vinci 84 (0.2) 83 (0.3) 84 (0.3) 
The Green Sea Turtle 89 (0.2) 90 (0.3) 89 (0.3) 
Where's the Honey? 81 (0.2) 79 (0.4) 82 (0.3) 
Icelandic Horses 80 (0.2) 82 (0.3) 77 (0.3) 

Shared PIRLS/PIRLS Literacy Passages 
Flowers on the Roof 92 (0.2) 96 (0.2) 89 (0.3) 
Sharks 86 (0.2) 83 (0.3) 89 (0.3) 
Pemba Sherpa 92 (0.2) 94 (0.2) 90 (0.3) 
How Did We Learn to Fly? 93 (0.2) 92 (0.2) 93 (0.2) 

PIRLS Literacy Passages 
Baghita's Perfect Orange 96 (0.4) 97 (0.4) 96 (0.6) 
The Pearl 96 (0.4) 97 (0.4) 95 (0.7) 
The Summer My Father Was Ten 95 (0.4) 97 (0.4) 93 (0.7) 
Library Mouse 95 (0.5) 97 (0.6) 94 (0.8) 
Training a Deaf Polar Bear 95 (0.5) 96 (0.6) 94 (0.7) 
African Rhinos & Oxpecker Birds 93 (0.5) 94 (0.6) 92 (0.8) 
Ants 95 (0.4) 96 (0.5) 94 (0.7) 
Hungry Plant 93 (0.5) 93 (0.7) 93 (0.7) 


Average Percent 


faa [ees ee 


Percent of Students 


Who Liked the Passage 


ALot ora Little 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Example: 


I liked it a lot ------------------------ 
I liked it a little --------------------- 
I didn’t like it very much--------- 


I didn’t like it at all ---------------- 


© 
©) 
&) 
@ 


How much did you like reading Shiny Straw? 


Fill one circle only. 
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International Achievement in Read 
Russian Federation@ Singapore G5 Fou 


tudents in 
th deration 
1 had the 


Hong Kong SARG@ Ireland gy Finland qq 
Poland@@® Northern Irelandgp 


Norway (5) Chinese TaipeiGp Englandg@p 
LatviaG@p Swedené> Hungarye@y by Ho 
BulgariaGp United States@D Lithuania@p 
Italy@B Denmark@y Macao SARG@ Netherlands@p 
Australia@z) Czech Republic@p Canadag@p 

Slovenia@® Austria@y) Germany@&y Kazakhstan@p 
Slovak Republic Israele) Portugal@ Spaingp 
Belgium (FI) New Zealand@ FranceG Belgium (Fr)@y 
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MaltaGp United Arab Emirates€) Bahrain@D Qatar@D 
Saudi Arabia€Ep Iran, Islamic Rep. of OmanGp 
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Trends at Fourth Grade Show Increases in 
Achievement Around the World 


Trends 2011-2016: 41 Countries 


18 Countries 

Higher Average 
Achievement 2 
Australia, Austria, Bulgaria, 
Chinese Taipei, England, 


Hungary, Ireland, Italy, Lithuania, 


Morocco, Norway (4), Oman, 
Qatar, Russian Federation, 


13 Countries 

Same Average 
Achievement 

Azerbaijan, Czech Republic, 


Finland, Georgia, Germany, 
Hong Kong SAR, Netherlands, 


Northern Ireland, Saudi Arabia, 


Singapore, Slovak Republic, 


10 Countries _~ 
Lower Average 
Achievement 


Belgium (French), Canada, 
Denmark, France, 

Iran, Islamic Rep. of, 

Israel, Malta, New Zealand, 
Portugal, United States 


Slovenia, Spain, Sweden, South Africa, Trinidad and Tobago 


United Arab Emirates 


Trends 2001-2016: 20 Countries 


11 Countries 7 Countries 2Countries _~ 
Higher Average Same Average _~# Lower Average 
Achievement 2 Achievement Achievement 


Czech Republic, Hong Kong SAR, France, Netherlands 
Hungary, Iran, Islamic Rep. of, 
Italy, Latvia, Norway (4), 
Russian Federation, Singapore, 


Slovak Republic, Slovenia 


Bulgaria, England, Germany, 
Lithuania, New Zealand, 
Sweden, United States 


Girls Had Higher Reading Achievement 
in More Countries Than Boys 


Of the 50 PIRLS 2016 Countries: 
* Girls had higher achievement in 48 countries, with an average difference of 19 points. 


¢ 2countries had no difference between boys and girls in average reading achievement. 
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CHAPTER 1 


Student Achievement 


Exhibit 1.1: Distribution of Reading Achievement 

Exhibit 1.1 shows distributions of student achievement for the participants in PIRLS 2016, including 
the average scale score with its 95 percent confidence interval and the ranges in performance for the 
middle half of the students (25" to 75" percentiles) as well as the extremes (5 and 95" percentiles). 
The PIRLS achievement scale summarizes fourth grade students’ performance answering questions 
designed to measure their reading comprehension across two overarching purposes for reading— 
literary and informational purposes, as well as a range of comprehension processes. The results for 
countries participating in PIRLS as well as its less difficult version, PIRLS Literacy, are reported on 
the PIRLS reading achievement scale. Both the PIRLS and the PIRLS Literacy assessments included 
12 passages (6 literary and 6 informational) with four passages in common. PIRLS included 175 
items and PIRLS Literacy included 183. 

The PIRLS reading achievement scale was established in PIRLS 2001, based on the achievement 
across all participating countries, treating each country equally. The scale has a typical range of 
achievement between 300 and 700. A centerpoint of 500 was set to correspond to the mean of overall 
achievement in 2001, with 100 points set to correspond to the standard deviation. Achievement 
data from each subsequent PIRLS assessment have been reported on this scale, so that increases or 
decreases in achievement may be monitored across assessments. PIRLS uses the scale centerpoint 
as a point of reference that remains constant from assessment to assessment. 

The results show that a number of countries performed quite well in PIRLS 2016, with 34 
countries having higher achievement than the centerpoint of 500. The results also reveal that 
although the differences from country to country were small, there was a substantial range in 
performance from the top-performing to the lower-performing countries. 
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Exhibit 1.1: Distribution of Reading Achievement 


Country Average 
Scale Score 
Russian Federation 581 (2.2) O eT - — 
3 Singapore 576 (3.2) (4) eee = Sa 

2 t Hong Kong SAR 569 (2.7) © —s = = 
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P Pins scaleCenterpoint [500 | 
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Saudi Arabia 430 (4.2) @ — = — 
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Oman 418 (3.3) @ i -= —— 
Kuwait 393 (41) @ _——— — ——— 
Morocco 358 3.9) ® —ES = ——S— 
Egypt 2h ——— — a 
South Africa 320 (44) @ — — a 
100 ae an 400 ay 400 ane a 


© Country average significantly higher than Percentiles of Performance 
the centerpoint of the PIRLS scale Sth 25th 75th 95th 


@ Country average significantly lower than = i ——=3) a 


the centerpoint of the PIRLS scale 1 
95% Confidence Interval for Average (+2SE) 


Note: Five countries and one benchmarking entity participated in the PIRLS Literacy assessment: Egypt, Iran, Kuwait, Morocco, and South Africa as well as Denmark (3). 
Iran and Morocco also took part in the fourth grade assessment and their results are based on an average of both assessments. 


The PIRLS achievement scale was established in 2001 based on the combined achievement distribution of all countries that participated in PIRLS 2001. To provide a point of 
reference for country comparisons, the scale centerpoint of 500 was located at the mean of the combined achievement distribution. The units of the scale were chosen so that 100 
scale score points corresponded to the standard deviation of the distribution. 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 1.1: Distribution of Reading Achievement (Continued) 


Country 


Benchmarking Participants 


Moscow City, Russian Fed. 


2 Madrid, Spain 

= Quebec, Canada 
Ontario, Canada 
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Abu Dhabi, UAE 


Eng/Afr/Zulu - RSA (5) 


Average 
Scale Score 


612 (2.2) 
549 (2.0) 
547 (2.8) 
544 (3.2) 
525 (2.1) 
517 (2.0) 
515 (1.9) 
501 (2.7) 
480 (3.1) 
414 (4.7) 
406 (6.0) 


Downloaded from http://pirls2016.org/download-center/ 


cooocco 


©@@O®@ 


T 
100 200 300 


Country average significantly higher than 
the centerpoint of the PIRLS scale 


Country average significantly lower than 
the centerpoint of the PIRLS scale 


Reading Achievement Distribution 


Percentiles of Performance 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


i] 
95% Confidence Interval for Average (+2SE) 


TIMSS & PIRLS 
IE A International Study Center 


Lynch School of Education 
BOSTON COLLEGE 


50I6 

2016 Gp crade 
Exhibit 1.2: Multiple Comparisons of Average Reading Achievement 
Because there often were relatively small differences in achievement between countries, Exhibit 
1.2 shows whether the differences in average achievement among the countries are statistically 
significant. 

The Russian Federation and Singapore were the top-performing countries, with similar 
achievement. Fourth grade students in the Russian Federation had higher achievement than students 
in all of the other countries except Singapore. In turn, Singaporean students had higher achievement 
than those in all of the other countries except the Russian Federation and Hong Kong SAR. Hong 
Kong SAR was another top performer, with achievement similar to or higher achievement than all 
the countries except the Russian Federation. Ireland, Finland, Poland, and Northern Ireland also 


performed very well, having achievement similar to or higher than than all the other countries except 
the Russian Federation and Singapore. 
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Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicate whether the 
average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher than that of the comparison 


country, or if there is no statistically significant difference between the average achievement of the two countries. 


je6nuog 

jeeus| 

aIGnday 4eAojs 
uejsyxezey, 
Auewas 
elisny 
eIUZAO|S 
epeue> 
dIqnday ydez> 
eqensny 
spueyauiaN 
us cede 
yaewuaqg 

Ajey 

ejuenyyy] 
sajels paun 
euebing 
AseBuny 
UapeaMs 

eIA}e] 

puej6ug 

ladiey asaulyD 
(¢) AeMION 
puejay] WayvoN 
puejod 

puejuly 

puejad| 

yvs buoy Buoy 
aiodebuls 
uoleJapaj ueissny 


al0IS ayers abesaay 


99909009900000009090900900090090909090900009090 
9990900900909090900090090909009000909909009009000 
9990900909090090090000909090009009099009009 
999090090909009009000909090090909090090090990090090 
99900009000900900009009009009009000090 
9990900909009009000009090900090 


99990090900900090 
9999009090900090090 
9999000900900900000 
99990090909090090090 
9999090990000 
999000000900000 
99909000900900900090 
9999009009000090 
999099009090909000090 

99990009009009000090 


999090000 HBBOBOHHDHDHHOHH DH HHHH HDHD HHHHHH OOD 
9990090000 HBOHHDH HH HHH HHH HOHOH HHH HOHOH HHH HHOHH®HHoOo 
999090000 HOHHGHHDHHHGHG HHH HHH HHH HHHGH HDHD HHHH®HH HHS 
99909000900 HSBHHSHHSH HSH HSH HSH HSH HSH HSH HSHGHSHHSHOHSHOHSHOHSHHSHSHSOD 
999090000 HBOHHHHDHHHHGH HH HHH HHH HHH HHH HHHHHHHHHHHOD 
9900090 HBOHHSHHD HD HHH HHH HHH HHH HHH HHH HHOHHH PH HHHHHOD 
999000 HOHHGSH HH HHH HHH HHH HHH HHOHBH HDHD HHOHH HDHD HHHSHSD 
0°90 HBOHHOHDHHDHGD GAD OG HDHGHDHGHD HGH HGHD HGH OHGOODOHGHDHGHDHGADHGODHSOHOSOSHSOSSoO® 
(<<) HDBHHSHH HHH HHH HHHH HDHD HHH HHH HHH HDHD HHHHHD DH HHHHHOD 
(<<) HDBHHHHDHOHGH HHH HHH HHH HHH HHH HOHOHH HDHD HOHOHH HH HHHHHHoOo 
i) HHHSHH HHH HHH HHGHGH HDHD HHHH HDHD HOHGHBH HDHD HHGOHBH PDH HHHH®HHoOO 
9° HBHHHOHSHDHGHDHG HD HGHOHGPDHG HSH HDHGHDHGHD HG OGD HG HOHGHDHGOHGHDHSOHOHSHHSOGoO® 
HDHHHDH HHH HHH HHH HHH HHH HHH HH HH HDHD HHH HHH HDHHHHHHHHHHOD 
HOGG HH HHH HHH HHH HHH HOHOGHG HHH HOHGHG HHH HHHH HDHD HHOHH HH HHHSHSD 
AARRRSHNCNNSARTAQIT SDT SR HRT ASTANA AMP ANCA SHAENMANARANMANSMH ASS 
Agddt ddA Ne Kn AN Yy HAAN KC Ke AN KWAN Ke WN NN te WK IYI S 
Be Be eg feds vs ys fee fers fetch (ech fe ech Desh ec es ed eS BS aS eS eS es se 
CYHOVVUDUGRTISS SS YSSYEYEVYEGSTACUGBSSVYSYVOCHY SESH SHOES 
SOAR SR SaSSPUSSESESSHESSS TR SESSTSSSEVEPRSS SERA GES RE 
CPE EOE SP eT SK es Fees eS Sze ea SESE SO ES a= eRe ss SHS 
cece @eece @reve Scezeve ace & SNet Ocoee ce ace. 
OR™ = ri) S| ~ = 0% = = S oes oO 5 2 
ea Da = ls ic =f oO <6 Ea 5 = o a & oS 
= = e © = oO 2 S32 = s iy ” 
S oO omU N xe) D i) Re se 2 
a Zz SS a o g cs) ns SI 
5 [oa] ee) ‘e £ oO 
ee = ‘c = 
- 5 


9 
9 
9 
9 
9 
<) 


HBHHBHHHHOOHD HH HOHHH®® 
HBHHHHHOHOHBDOHDHHOHOHHHH®® 
HBHHHHHHGHHHHHOHOBD HH HOO 
HHHHHHHHGHBHHHSHOHOHD HH ®OoO® 
HBHHBHHHSHHOHHHHSHHHD HHS HSOOOD 
HDHHHHHHOHHHHHHOBDHDHHHHH®® 
HHHSHHHHGHHHHHOHOHBHHHSHOHHB®HH&® 
HHHHHHHGHHHHHOHOHHHHSHOHHH Se 
HBHHHHSHOHOHDHHHHHOBD HH HSHHGHDH OS® 
HHHHHHHGHHHHHHOHDHHHHOHOHHH®® 
HHHHHHHHGHHHHHOHGHDHHHSHOHOHBH S&S ®® 
HBHHHHHHHOHHDHHHHOHBHDHHHHOBHH&® 
HBHHHHGHHHHHHHHOHDHDHHHHOHBHH HOOD 
HHHHHHHOHHHHHHOHHHHHOOHBOHH HOOD 
HBHHHHHHGHHHHHHGHHHHSHOHOHHH#&OoOD 
HBHHHHHOHOHDHHHHOHGDHDHHHHHDHH HOOD 


Benchmarking Participants 


999090 8 ®©®®®® 
999090 88 © ®8®® 
YV9DIDIDHOO®HOHH® 
9990 ®S©8©888® 
9990 S08 ©8888 
9°90 ®HBBB®HSHO® 
9°90 ®HB®BHHHO® 
99 ®HBHH®e®O® 
®B®B®®SSO® 
®B®B®H®H®O® 
HBHH®S8O® 
®B®BHB®SSO® 
®B®BHB®H®O® 
®BHBHHeHO® 
HBHH®HSO® 
®B®BHOSO® 
®BBB®H®O® 
9 ®HBOHHBHH®O® 
YBHHOHSHOOSHH®® 
YBHBHOHSOOHHO® 
YBHBHOHoOOOHH®® 
YBHHOHOHOOHH®® 
YBHOHSHSOOHHS#® 
YHHOHSOOOHH®® 
YBBHBHHOHOOXH®H®® 
YBHHHHOOHH®® 
YWHHHHOOHH®® 
YBHBHOHSOOHHSO® 
YBHBHHOHOOHH®® 
VBHOHSOOSHHeO® 


3 


00000000 


aac eo ei— e~ ay 
a Fs eae eses 
omnnnnnnn +t t+ 
;emmaecourown 
My) hol Ge ESS = DD 
wet onrvebodg 
Oo ~= fC. 
cM ae Sat cae 
goVUUs Fa2EQs 1 
Fug > iS 
$ue2S5z2qg7%G2 
xeSogn an > 
~S urs Yvan 
iS Soi =o2> 
5 oO¢d <S 
ry = 
= fo)) 
fe) a fe 
v) v ui 
n =) 
{e) [a2] 
= 


© Average achievement significantly higher than comparison country 


@ Average achievement significantly lower than comparison country 


Significance tests were not adjusted for multiple comparisons. Five percent of the comparisons would be statistically significant bv chance alone. 
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Exhibit 1.3 and 1.4: Trends in Reading Achievement 
PIRLS 2016 is the fourth assessment of PIRLS. Differences in average reading achievement are 
presented for the countries that have comparable data from the previous assessments in 2001, 2006, 
and 2011. Exhibit 1.3 depicts the results graphically for the countries in alphabetical order, while 
Exhibit 1.4 provides the detailed results from assessment to assessment. The trends in reading 
achievement signal more improvements than downturns internationally in reading achievement at 
the fourth grade. Twenty countries have data for the 15 year period between 2001 and 2016, with 
11 showing increases—including 4 with gains of more than 40 points (Hong Kong SAR, the Russian 
Federation, Singapore, and Slovenia). Average achievement in 7 of the 20 countries remained similar 
between 2001 and 2016, and it decreased in only 2 countries (France and the Netherlands). 

Forty-one of the countries participated in both PIRLS 2011 and 2016, with 18 showing 

improvements, 13 having similar achievement, and 10 showing declines. 
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Exhibit 1.3: Trends in Reading Achievement 


Displays changes in achievement for the countries and benchmarking participants that have comparable data from previous PIRLS exhibits. The same scale is 
used for each country (10-point intervals), but the part of the scale shown differs according to each country's average achievement. The accompanying table 
(Exhibit 1.4) provides details, including statistical significance. 
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Exhibit 1.3: Trends in Reading Achievement (Continued) 
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Exhibit 1.3: Trends in Reading Achievement (Continued) 
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Exhibit 1.3: Trends in Reading Achievement (Continued) 
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Exhibit 1.3: Trends in Reading Achievement (Continued) 
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Exhibit 1.4: Differences in Reading Achievement Across Assessment Years 


Instructions: Read across the row to determine if the performance in the row year is significantly higher (Q) or significantly lower (@) 


than the performance in the column year. 
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Trend results for Azerbaijan do not include students taught in Russian. Trend results for Lithuania do not include students taught in Polish or in Russian. 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors apvear in parentheses. Because of roundina some results mav appear inconsistent. 
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Exhibit 1.4: Differences in Reading Achievement Across Assessment Years 
(Continued) 
Instructions: Read across the row to determine if the performance in the row year is significantly higher (Q) or significantly lower (®) 
than the performance in the column year. 
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Exhibit 1.4: Differences in Reading Achievement Across Assessment Years 
(Continued) 
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Exhibit 1.4: Differences in Reading Achievement Across Assessment Years 
(Continued) 

Instructions: Read across the row to determine if the performance in the row year is significantly higher (Q) or significantly lower (@) 
than the performance in the column year. 
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Exhibit 1.5: Average Reading Achievement by Gender 
In PIRLS 2016, fourth grade girls had higher average achievement than boys in all countries except 
Macao SAR and Portugal, where achievement was similar for boys and girls. The average advantage 


for girls was 19 points across the 50 countries in PIRLS 2016. 
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Exhibit 1.5: Average Reading Achievement by Gender 


Country 
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See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


a 


Percent of | Average Scale | Percentof | Average Scale 
Students Score Students Score 
) 


49 (0.5) 546 (1.6 51 (0.5) 545 (1.7) 
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50 (0.9 515 (2.6) 50 (0.9) 507 (2.5) 
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50 (0.9 577 (1.9) 50 (0.9) 555 (2.3) 
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48 (2.6) 464 (5.4) 52 (2.6) 399 (5.8) 
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Exhibit 1.5: Average Reading Achievement by Gender (Continued) 
Poe fm | 


Percent of | Average Scale} Percentof | Average Scale 
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SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 
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Exhibit 1.6: Trends in Reading Achievement by Gender 

For the countries with trend data from previous PIRLS assessments, Exhibit 1.6 shows graphs of 
average achievement by gender. The countries are presented in alphabetical order. In nearly all of 
the countries, girls have had higher achievement than boys, historically as well as in PIRLS 2016. 
Portugal was the only country to close the gender gap in 2016, and this was in comparison to PIRLS 
2011. Several countries narrowed the gap in 2011 (France, Israel, Italy, and Spain), but then girls 
once again had higher achievement than boys in PIRLS 2016. 
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Exhibit 1.6: Trends in Reading Achievement by Gender 


Scale interval is 10 points for each country, but the part of the scale shown differs according to 
each country's average achievement. 
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2001 2011 2016 
549* 549* 
ee 
542 
538 
531 
Z TIMSS & FIRLS 
International Study Center 
Zw l EA Lynch School of Education 


BOSTON COLLEGE 


39 


Downloaded from http://pirls2016.org/download-center/ 


WAU ip crade 


Exhibit 1.6: Trends in Reading Achievement by Gender (Continued) 
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Exhibit 1.6: Trends in Reading Achievement by Gender (Continued) 
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Exhibit 1.6: Trends in Reading Achievement by Gender (Continued) 
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Exhibit 1.6: Trends in Reading Achievement by Gender (Continued) 
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Exhibit 1.6: Trends in Reading Achievement by Gender (Continued) 
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CHAPTER 2 


Performance at International 
Benchmarks 


The PIRLS 2016 International Benchmarks of Reading 
Achievement 


To provide an interpretation of the results summarized on the PIRLS achievement scale for reading 
comprehension at the fourth grade, PIRLS describes achievement at four points along the scale 
as international benchmarks: Advanced International Benchmark (625), High International 
Benchmark (550), Intermediate International Benchmark (475), and Low International Benchmark 
(400). To develop the descriptions, the TIMSS & PIRLS International Study Center conducted a 
scale anchoring analysis together with the PIRLS 2016 Reading Development Group (RDG). The 
descriptions of achievement at the International Benchmarks are based on the reading skills and 
strategies demonstrated by fourth grade students achieving at each level of the scale. Further detail 
about the scale anchoring methodology is provided in Chapter 13 of Methods and Procedures in 
PIRLS 2016. 


Overview of the PIRLS 2016 Texts PIRL S 


and Items Assessment Framework 


The texts and items used in PIRLS 2016 were 

selected and developed based on the PIRLS fees % % eee 
Experience Use Information 

aN 


2016 Assessment Framework. The framework 
Focus on and Retrieve 


—— 
2 0% Explicitly Stated 2 0% 


Information 
3 0% Make Straightforward 3 0% 
Inferences 
0/ _ Interpret and Integrate 0 
3 0 % Ideas and Information 3 0 % 
Evaluate and Critique 
20” Content and 20” 


Textual Elements 


describes the PIRLS view of reading as an 
interactive process between the text and the 
reader and describes the ways that PIRLS 
measures students’ reading achievement. 


It specifies that the assessment texts and 


items should cover in equal amounts the 
two purposes that account for most of the 


reading done by young students in and out 


of school: 


e For literary experience 


e To acquire and use information 


CHAPTER 2: PERFORMANCE AT INTERNATIONAL BENCHMARKS 2 TIMSS & PIRLS 
International Study Center 49 
PIRLS 2016 INTERNATIONAL RESULTS IN READING Gg IEA i aiisaneal eeceestiGn 


Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


50I6 
2016 GiDP crade 

Across the literary and informational texts, the PIRLS items measure four processes of 
comprehension: retrieving, straightforward inferencing, interpreting and integrating, and evaluating 
and critiquing. 

For PIRLS 2016, the assessment was extended to include a less difficult assessment known as 
PIRLS Literacy. The purpose of the PIRLS Literacy assessment is to provide better measurement at 
the lower end of the PIRLS achievement scale. 

The PIRLS Literacy assessment is equivalent to PIRLS in scope and reflects the same conception 
of reading as PIRLS, but in addition to passages in common with PIRLS it includes some less difficult 
texts. Including PIRLS and PIRLS Literacy, the 2016 assessment included 20 different passages: 
8 only in PIRLS, 4 in both PIRLS and PIRLS Literacy, and 8 only in PIRLS Literacy. The reading 
passages and questions in common between the PIRLS and PIRLS Literacy assessments enable the 
two assessments to be linked, so that the PIRLS Literacy assessment results can be reported together 
with PIRLS assessment results and directly compared with them. The range of texts and items—from 
the relatively complex texts and items in PIRLS to the shared passages, to the relatively simpler 
passages in PIRLS Literacy—provided an excellent basis for the PIRLS 2016 scale anchoring analysis. 

To provide examples of the assessment passages and items, five texts together with their 
associated items and scoring guides can be found in Appendix H. All five texts are designated as 
“restricted use,” which means that they are reproduced here with permission from the IEA. Any 
further reproduction or use of these passages requires permission from the IEA. Two of the passages 
in Appendix H are from PIRLS 2016, including “Macy,” a literary text about a teenage girl, and 
the informational text “The Green Sea Turtle’s Journey.” One passage, “Flowers on the Roof,’ was 
included in both the PIRLS and PIRLS Literacy assessments. There also are two released passages 
from PIRLS Literacy, including “The Pearl,” which is a story about a boy who found a rare pearl, 
and “Rhinos,” which describes the relationship between rhinos and oxpecker birds. The PIRLS and 
PIRLS Literacy formats are different. The PIRLS texts were followed by the items, whereas the PIRLS 
Literacy texts were presented in a slightly larger font and the items were interleaved “side by side” 
within the texts. 


Description of the Literary and Informational Texts 

Consistent with the two reading purposes that provide the foundation of the PIRLS 2016 Assessment 
Framework, the scale anchoring analysis was conducted separately for the literary and informational 
texts and items. The assessment was divided equally between the two purposes, such that across 
PIRLS and PIRLS Literacy it included 10 literary texts and 10 informational texts. 
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Literary Reading 
In literary reading, readers engage with the text to become involved in events, settings, actions, 


consequences, characters, atmosphere, feelings, and ideas, and to enjoy language. 


PIRLS 


2016 


The literary texts were complete short stories or episodes accompanied by supportive illustrations. The ten 
passages included contemporary and traditional stories with one or two main characters, a plot with one 
or two central events, and an overall theme or message. The simpler texts were approximately 500 words 

in length with a clear linear structure and explicit meanings. The language featured everyday vocabulary 
and straightforward sentence structures. The texts and questions were presented side by side to support the 
location of information. The relatively complex texts were approximately 800 words in length with scope for 
exploring layers of meaning, such as plot twists and character development. The passages included a range 
of styles and language features, such as first-person narration, humor, dialogue, and some 

figurative language. 


iterary 


Informational Reading 

Informational texts are both read and written for a wide variety of functions. While the primary 
function is to provide information, depending on the objectives writers address their subject matter 
using a variety of formats (e.g., biography, persuasive essay, instructions, or argument). 


[nformationa 


== 

= The ten informational passages included a variety of continuous and non-continuous texts. They had 
presentational features such as diagrams, maps, illustrations, photographs, or tables. The range of material 
covered scientific, ethnographic, biographical, and historical information and ideas. Texts were structured 
in anumber of ways, including by logic, argument, chronology, and topic. Several included organizational 
features such as subheadings or text boxes. The simpler texts were approximately 400 to 500 words in length 
with a clear structure and explicit meanings, and straightforward sentence structures. The texts and 
questions were presented side by side to support the location of information. The relatively complex texts 
were approximately 600 to 900 words in length and conceptually more demanding, some of them based on 
abstract or technical ideas and with a substantial number of embedded details. Sentence structures may be 
complex and vocabulary unfamiliar. 
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Description of the PIRLS 2016 International Benchmarks 

The graphic shows the descriptions of the skills demonstrated by fourth grade students at each of 
the four International Benchmarks. Benchmark descriptions at each level are shown separately for 
literary and informational reading to reflect the varying demands that different types of texts present. 
With each reading purpose, the progression in reading comprehension processes is evident from 
benchmark to benchmark. 


@e Advanced International Benchmark 


6) ) 5 When reading relatively complex Literary Texts, students can: 


+ Interpret story events and character actions to describe reasons, motivations, feelings, and 
character development with full text-based support 

* Begin to evaluate the effect on the reader of the author's language and style choices 

When reading relatively complex Informational Texts, students can: 


* Distinguish and interpret complex information from different parts of text, and provide full text- 
based support 

+ Integrate information across a text to explain relationships and sequence activities 

* Begin to evaluate visual and textual elements to consider the author's point of view 


High International Benchmark 


5 5 @) When reading relatively complex Literary Texts, students can: 


* Locate and distinguish significant actions and details embedded across the text 
+ Make inferences to explain relationships between intentions, actions, events, and feelings, and 
give text-based support 


+ Interpret and integrate story events and character actions, traits, and feelings as they develop 
across the text 


* Recognize the use of some language features (e.g., metaphor, tone, imagery) 


When reading relatively complex Informational Texts, students can: 


+ Locate and distinguish relevant information within a dense text or a complex table 
+ Make inferences about logical connections to provide explanations and reasons 


+ Integrate textual and visual information to interpret the relationship between ideas 
* Evaluate and make generalizations about content and textual elements 
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ee Intermediate International Benchmark 


4 7 5 When reading a mix of simpler and relatively complex Literary Texts, students can: 


+ Independently locate, recognize, and reproduce explicitly stated actions, events, and feelings 

* Make straightforward inferences about the attributes, feelings, and motivations of main characters 
+ Interpret obvious reasons and causes, recognize evidence, and give examples 

+ Begin to recognize language choices 


When reading a mix of simpler and relatively complex Informational Texts, students can: 


+ Locate and reproduce two or three pieces of information from text 
* Make straightforward inferences to provide factual explanations 


* Begin to interpret and integrate information to order events 


SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 


( ay Low International Benchmark 


ZAR OT@) When reading predominantly simpler Literary Texts, students can: 


* Locate and retrieve explicitly stated information, actions, or ideas 
* Make straightforward inferences about events and reasons for actions 


* Begin to interpret story events and central ideas 


When reading predominantly simpler Informational Texts, students can: 


* Locate and reproduce explicitly stated information from text and other formats (e.g., charts, 
diagrams) 
* Begin to make straightforward inferences about explanations, actions, and descriptions 


CHAPTER 2: PERFORMANCE AT INTERNATIONAL BENCHMARKS oe TIMSS & PIRLS 
International Study Center 53 
PIRLS 2016 INTERNATIONAL RESULTS IN READING g IE Pee eas 


Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


50I6 

2016 GIP crade 
Exhibit 2.1: Performance at the International Benchmarks of 
Reading Achievement 
Exhibit 2.1 presents the percentage of students reaching each PIRLS 2016 International Benchmark. 
The results are presented in descending order according to the percentage of students reading the 
Advanced International Benchmark. The percentage of students reaching the Advanced Benchmark 
is indicated in the bar graph with a black dot. Because students who reached the Advanced 
Benchmark also reached the other benchmarks, the percentages illustrated in the exhibit and shown 
in the columns to the right are cumulative. More than one-fourth of the fourth grade students 
reached the Advanced International Benchmark in Singapore (29%) and the Russian Federation 
(26%). 

As a point of reference, Exhibit 2.1 provides the median percentage of students reaching each 
benchmark at the bottom of the four right-hand columns. By definition, half the countries will 
have a percentage in that column above the median and half will be below the median. The median 
percentages of students reaching the International Benchmarks were as follows: Advanced—10 
percent, High—47 percent, Intermediate—82 percent, and Low—96 percent. About half the PIRLS 
countries (24) had more than 96 percent of their students reaching the Low Benchmark, and in five 
countries, essentially all the students (99%) reached this benchmark—the Russian Federation, Hong 
Kong SAR, Norway, Latvia, and the Netherlands. 
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Exhibit 2.1: Performance at the International Benchmarks of Reading Achievement 


Country 


3 Singapore 
Russian Federation 
Northern Ireland 
Ireland 
Poland 
England 
Bulgaria 

2 t Hong Kong SAR 

Finland 
Hungary 

t United States 
Australia 
Norway (5) 
Chinese Taipei 
Sweden 

2 Latvia 

3 Israel 

12 Canada 
Lithuania 
Slovenia 

2 Denmark 
New Zealand 
Germany 
Italy 
Slovak Republic 
Czech Republic 
Macao SAR 

2 Austria 

t Netherlands 
Kazakhstan 

2 Portugal 
Spain 
United Arab Emirates 
Trinidad and Tobago 
Belgium (Flemish) 
France 
Chile 
Qatar 

2 Belgium (French) 

1 Georgia 
Bahrain 
Oman 
Azerbaijan 
Iran, Islamic Rep. of 
Saudi Arabia 

2 Malta 
Kuwait 
Egypt 
Morocco 
South Africa 
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Advanced 


Benchmark 


(4) 


29 (1.6) 
26 (1.2) 
22 (1.4) 
21 (1.2) 
20 (1.1) 
20 (0.9) 
19 (1.3) 
18 (1.3) 
18 (0.8) 
17 (1.2) 
16 (1.3) 
16 (1.0) 
15 (0.9) 
14 (1.1) 
14 (1.4) 
14 (1.0) 
13 (0.9) 
13 (0.7) 
12 (0.9) 
11 (0.8) 
11 (1.0) 
11 (0.6) 
11 (0.8) 
11 (0.8) 
10 (0.8) 
10 (0.7) 
10 (0.6) 
8 (0.8) 
8 (0.6) 
7 (0.8) 
7 (0.9) 
6 (0.4) 
5 (0.3) 
4 (0.5) 
4 (0.4) 
4 (0.6) 
3 (0.4) 
3 (0.3) 
3 (0.4) 
2 (0.4) 
2 (0.3) 
2 (0.3) 
2 (0.3) 
1 (0.2) 
1 (0.4) 
1 (0.2) 
1 (0.2) 
0 (0.1) 
0 (0.1) 
0 (0.1) 


Benchmark 


(550) 


66 (1.6) 
70 (1.3) 
61 (1.3) 
62 (1.6) 
61 (1.3) 
57 (1.1) 
55 (2.2) 
65 (1.8) 
62 (1.3) 
56 (1.7) 
53 (1.6) 
51 (1.4) 
58 (1.7) 
59 (1.5) 
57 (1.6) 
57 (1.3) 
46 (1.3 
50 (1.0 
52 (1.6 
49 (1.3 
52 (1.3 
AI (1.2 
47 (1.4) 
52 (1.7) 
47 (1.4) 
49 (1.3) 
50 (0.8) 
47 (1.5) 
48 (1.3) 
42 (1.8) 
38 (1.3) 
39 (0.9) 
20 (1.0) 
24 (1.2) 

35 (1.3) 

30 (1.3) 

25 (1.3) 

17 (0.6) 

22 (1.2) 

22 (1.3) 

14 (0.6) 

10 (0.8) 

18 (1.1) 

11 (0.6) 

11 (1.2) 

13 (0.7) 

6 (0.8) 

3 (0.4) 

3 (0.4) 

2 (0.4) 


) 
) 
) 
) 
) 
) 


Intermediate 
Benchmark Benchmark 
(CYL) C1) 


89 (1.0) 97 (0.5) 
94 (0.6) 99 (0.3) 
87 (0.8) 97 (0.4) 
89 (0.9) 98 (0.4) 
89 (0.7) 98 (0.4) 
86 (0.7) 97 (0.4) 
83 (1.6) 95 (0.9) 
93 (0.9) 99 (0.3) 
91 (0.8) 98 (0.3) 
85 (1.0) 97 (0.5) 
83 (1.2) 96 (0.5) 
81 (1.0) 94 (0.5) 
90 (0.9) 99 (0.3) 
90 (0.7) 98 (0.2) 
88 (0.9) 98 (0.3) 
90 (0.8) 99 (0.2) 
75 (1.0) 91 (0.7) 
83 (0.9) 96 (0.4) 
86 (1.1) 97 (0.5) 
83 (0.9) 96 (0.5) 
86 (1.0) 97 (0.4) 
73 (1.0) 90 (0.7) 
81 (1.4) 95 (1.0) 
87 (1.0) 98 (0.5) 
81 (1.3) 93 (1.1) 
85 (0.9) 97 (0.5) 
86 (0.5) 98 (0.3) 
84 (1.1) 98 (0.4) 
88 (0.9) 99 (0.3) 
84 (1.5) 98 (0.3) 
79 (1.3) 97 (0.4) 
80 (1.0) 97 (0.6) 
43 (1.4) 68 (1.3) 
55 (1.7) 80 (1.2) 
80 (1.3) 97 (0.4) 
72 (1.2) 94 (0.5) 
61 (1.5) 87 (1.1) 
42 (1.1) 66 (0.9) 
65 (1.4) 92 (0.9) 
60 (1.6) 86 (1.1) 
41 (1.0) 69 (1.0) 
32 (1.3) 59 (1.3) 
54 (2.0) 81 (1.7) 
37 (1.3) 65 (1.5) 
35 (1.7) 63 (1.8) 
45 (1.1) 73 (0.7) 
22 (1.5) 51 (1.7) 
11 (1.2) 31 (1.8) 
14 (0.8) 36 (1.5) 
8 (1.0) 22 (1.5) 


att) 47 82 
(EE SS Ee eee Eee 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.1: Performance at the International Benchmarks of Reading Achievement 
(Continued) 
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Country 
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Exhibit 2.2: Percentages of Students Reaching the International Benchmarks of 
Reading Achievement Across Assessment Years 
Exhibit 2.2 shows the changes in percentages of students reaching the benchmarks for countries that 
have participated in previous assessments (2001, 2006, and 2011). Of the 41 countries participating 
in both 2011 and 2016, 19 increased and 2 decreased at the Advanced International Benchmark, 
18 increased and 6 decreased at the High International Benchmark, 16 increased and 8 decreased 
at the Intermediate Benchmark, and 7 increased and 9 decreased at the Low Benchmark. Of the 
20 countries participating in both 2011 and 2016, 11 increased and 2 decreased at the Advanced 


International Benchmark, 12 increased and 2 decreased at the High Benchmark, 10 increased and 2 
decreased at the Intermediate Benchmark, and 8 increased and 2 decreased at the Low Benchmark. 
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Exhibit 2.2: Percentages of Students Reaching the International Benchmarks 
of Reading Achievement Across Assessment Years 
High 


Country 


Singapore 
Russian Federation 
Northern Ireland 
Ireland 

England 

Bulgaria 

Hong Kong SAR 
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Australia 
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An empty cell indicates a country did not participate in that year’s assessment or did not have comparable data. 
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Exhibit 2.3: Low International Benchmark (400) 


Exhibit 2.3 presents the description of fourth grade students’ achievement at the Low International 
Benchmark primarily based on results from the PIRLS Literacy assessment but also some results 
from PIRLS passages. Essentially, when reading the less difficult PIRLS Literacy texts, students could 
retrieve explicitly stated information and make straightforward inferences. 

Exhibits 2.3.1 through 2.3.9 contain nine examples of the types of items that anchored at the 
Low International Benchmark. There are six example items based on literary text, four from “The 
Pearl,’ which was only included in the PIRLS Literacy assessment, and two from “Flowers on the 
Roof,’ which was included in both the PIRLS and PIRLS Literacy assessments. There also are three 
example items based on the “Rhinos” informational text (see Appendix H). 

Each exhibit shows achievement results for the countries that participated in PIRLS Literacy 
and the two items from “Flowers on the Roof” also contain the results for all the countries that 
participated in PIRLS. The country-by-country results are accompanied with up and down arrows 
indicating a significantly higher or lower percentage of success than the international average. The 
reading purpose, comprehension process, and scale anchoring description are provided above the 
item. For multiple-choice items, the correct response is indicated. Constructed response questions 
were worth 1, 2, or 3 points. Each constructed response item is shown with an illustrative student 
response and the amount of credit awarded the response is shown across the bottom of the exhibit, 
usually full credit. 

Example Item 2.3.1 (constructed response) illustrates that students at the Low International 
Benchmark could retrieve an explicitly stated detail from “The Pearl” and Example Item 2.3.2 that 
they were able to make an inference about a detail from the beginning of the story. Example Items 
2.3.3 and 2.3.4 show students reaching this level also were beginning to interpret and integrate 
information presented across the text. In the latter case, they were asked about the “whole story” 
and responded with partial evidence (54% on average internationally). In Example Item 2.3.5 and 
Example Item 2.3.6 based on “Flowers on the Roof,’ students retrieved an explicitly stated detail and 
made an inference based on information at the end of the story. 

As shown in two example items based on “Rhinos,” Example Item 2.3.7 asking about a chart 
and Example Item 2.3.8 about a later section of the text, students could retrieve detailed information 
from different formats and sections of the text. Example Item 2.3.9 asked students to make an 
inference about why hunters want to kill rhinos. 
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Exhibit 2.3: Description of the PIRLS 2016 Low International Benchmark (400) 
of Reading Achievement 


( Jy Low Internationa 


ZAK @) @) When reading predominantly simpler Literary Texts, students can: 


+ Locate and retrieve explicitly stated information, actions, or ideas 
+ Make straightforward inferences about events and reasons for actions 


* Begin to interpret story events and central ideas 


When reading predominantly simpler Informational Texts, students can: 


+ Locate and reproduce explicitly stated information from text and other formats (e.g., charts, 


* Begin to make straightforward inferences about explanations, actions, and descriptions 


( 
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Exhibit 2.3.1: Low International Benchmark - Literary Example Item 1* 


p ' Purpose: Literary Experience 
ercen = = : 
Country Full Credit Process: Focus on and Retrieve Explicitly Stated Information 
ull Credi 


Description: Locate and reproduce an explicitly stated reason for a character’s words 


Morocco 78 (1.9) © 

Kuwait 23 (1.6) © 

Egypt 69 (19) © . Why does the girl say the pearl really belongs to 
Josh? 

Iran, Islamic Rep. of 42 (2.1) @ 

South Africa 41 (1.5) @ 


Benchmarking Participants 
2 Denmark (3) 70 (1.8) © 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


The answer shown illustrates the type of student response that would receive full credit (1 point). 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 
* Item administered only in PIRLS Literacy. 
See Appendix C.1 for target population coverage notes 1, 2, and 3. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.3.2: Low International Benchmark - Literary Example Item 2* 


Purpose: Literary Experience 
Process: Make Straightforward Inferences 


Description: Make a straightforward inference about a detail from the beginning of the 
story 


Percent 


COUNT, Correct 


Iran, Islamic Rep. of 70 (2.9) © 

Kuwait 63 (2.1) pe 

Morocco 61 (2.1) 1. Where does the boy find the pearl? 
(10 

South Africa 55(13) © ® on the beach 

Egypt eS beside the sea 
Benchmarking Participants © where they played games 

7 Denmark (3) 87 (1.3) O 


@ in the deeper water 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 
* Item administered only in PIRLS Literacy. 
See Appendix C.1 for target population coverage notes 1, 2, and 3. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.3.3: Low International Benchmark - Literary Example Item 3* 


Purpose: Literary Experience 
Process: Interpret and Integrate Ideas and Information 


Description: Integrate ideas to show understanding of how a character develops 


COUnITy Percent 
Full Credit 
Egypt 57 (2.0) O 
Morocco 52 (2.0) © 
Kuwait 50 (1.9) © 
Iran, Islamic Rep. of 48 (2.1) 


International Avg. CV (R)) 


South Africa 27 (17) @ 


Benchmarking Participants 
2 Denmark (3) 45 (2.1) 


3° 
® 


* Item administered only in PIRLS Literacy. 


See Appendix C.1 for target population coverage notes 1, 2, and 3. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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9. How does Reuben become a wealthy man? 


He, gets: As oF pearls framall over HHL world. 


Percent significantly higher than international average 
Percent significantly lower than international average 


The answer shown illustrates the type of student response that would receive full credit (1 point). 
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Exhibit 2.3.4: Low International Benchmark - Literary Example Item 4* 


Purpose: Literary Experience 


Description: Show understanding of a character’s trait by providing 1 (of 2) example of the 


Percent At 


Countr 
My Least 1 Point 


character's actions 


Egypt (2.1) 
eee ame > Think about the whole story. 
Kuwait 57 (2. 


International Avg. 54 (1.0 


Iran, Islamic Rep. of 49 (2.9) @ 


15. In the story, Josh is a good person. Write two things 
South Africa 43 (16) @ 


that Josh does that show he is a good person. 


Benchmarking Participants 


“TDenmak@) TO | =A. HE Alves away The earl 


Or we ECA NING 
A2. 


The answer shown illustrates the type of student response that would receive partial credit 
(1 of 2 points). 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 
* Item administered only in PIRLS Literacy. 
See Appendix C.1 for target population coverage notes 1, 2, and 3. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.3.5: Low International Benchmark - Literary Example Item 5 


ane Purpose: Literary Experience 
ercen = a 5 
Country Process: Focus on and Retrieve Explicitly Stated Information 


Correct 
Description: Retrieve and recognize explicitly stated information 


Sweden 95 (0.9) 
Italy 93 (1.1) — 
Ireland 93 (1.0) 4. Who offered to look after Granny Gunn’s animals when she moved 
Czech Republic 93 (1.0) to town? 
2 +t Hong Kong SAR 93 (1.2) 

® Nuit 93 (1.0) the people on the next farm 
Russian Federation 92 (1.2) 
Poland 91 (1.2) the doctor 

= Benimak mie) Granny Gunn’s family 
Northern Ireland 91 (1.4) 
Finland 91 (1. 1) Robert 

2 Latvia 91 (1.4) 
Chinese Taipei 90 (1.2) 
Slovenia 90 (1.4) 
England 90 (1.1) 
Macao SAR 90 (1.2) 
Norway (5) 90 (1.4) 
Germany 88 (1.3) 
Lithuania 88 (2.1) 
Australia 87 (1.5) 
Hungary 87 (1.8) 

3 Singapore 87 (1.0) 

t Netherlands 87 (1.6) 
France 87 (1.5) 
Kazakhstan 87 (1.4) 
Belgium (Flemish) 86 (1.3) 

12 Canada 86 (1.3) 

Slovak Republic 86 (1.6) 
Bulgaria 86 (2.1) 

2 Portugal 85 (1.5) 
New Zealand 84 (1.2) 
Spain 83 (1.3) 

t United States 83 (1.8) 

3 Israel 82 (1.4) 

' Georgia 82 (2.0) 
Azerbaijan 81 (1.9) pevent 

Country pe 

Belgium (French) 80 (1 7) 
Chile 77 (1.9) @ 
Trinidad and Tobago 75 (1.8) © Benchmarking Participants 
Iran, Islamic Rep. of 71 (1.9) @ Moscow City, Russian Fed. 95 (1.0) © 

2 Malta 69 (1.8) @ 2 Madrid, Spain 89 (14) O 
Qatar 61 (1.5) @ = Quebec, Canada 88 (2.0) © 
United Arab Emirates 61 (1.4) @ Ontario, Canada 87 (2.1) © 
Kuwait 60 (2.4) @ Andalusia, Spain 85 (1.4) © 
Bahrain 59 (1.4) @ Norway (4) 84 (1.7) 
Oman 55 (1.6) @ Buenos Aires, Argentina 81 (2.0) 
Saudi Arabia 50 (1.9) @ Dubai, UAE 77 (1.4) @ 
Morocco 47 (1.9) @ 2 Denmark (3) 77 (1.9) 
Egypt 43 (16) @© Eng/Afr/Zulu - RSA (5) 56 (3.2) @ 
South Africa 39 (1.6) @ Abu Dhabi, UAE 53 (2.3) @ 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.3.6: Low International Benchmark - Literary Example Item 6 


Country 


2 Austria 
Ireland 
Norway (5) 
Finland 

2 Denmark 
Poland 
Northern Ireland 

t Netherlands 
England 
Czech Republic 
Germany 
Spain 

2 Latvia 

2 t Hong Kong SAR 
12 Canada 

Australia 

t United States 
Belgium (Flemish) 

3 Singapore 
Slovak Republic 
Russian Federation 

2 Portugal 
Hungary 
New Zealand 
Italy 
Slovenia 
Bulgaria 
France 

3 Israel 
Chile 

2 Belgium (French) 
Lithuania 


Trinidad and Tobago 


Chinese Taipei 


International Avg. 80 (0.2) 


Macao SAR 
Sweden 

2 Malta 

1 Georgia 
Kazakhstan 


United Arab Emirates 


Iran, Islamic Rep. of 
Bahrain 

Qatar 

Oman 

Saudi Arabia 
Azerbaijan 

Kuwait 

Morocco 

Egypt 

South Africa 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


Percent 
Full Credit 


96 (0.8) 
95 (1.0) 
95 (1.0) 
94 (0.9) 
94 (1.0) 
94 (1.1) 
94 (1.2) 
94 (1.0) 
93 (0.9) 
93 (1.0) 
93 (1.0) 
92 (0.8) 
92 (1.4) 
92 (1.3) 
92 (0.8) 
92 (0.9) 
92 (1.2) 
91 (1.1) 
90 (0.9) 
90 (1.4) 
90 (1.4) 
88 (1.3) 
88 (1.7) 
88 (1.5) 
87 (1.6) 
87 (1.8) 
86 (1.5) 
86 (1.5) 
86 (1.4) 
86 (1.5) 
84 (1.6) 
83 (1.9) 
82 (1.9) 
81 (1.6) 


78 (1.5) 
77 (1.8) 
73 (1.8) 
71 (1.8) 
70 (2.0) 
67 (1.4) 
67 (1.9) 
62 (1.5) 
60 (1.3) 
58 (1.9) 
57 (2.4) 
55 (2.3) 
45 (2.3) 
36 (1.4) 
32 (1.9) 
32 (1.6) 


DOH GOH@DD@D@DOOGHOHO®O 


@ 


° 
® 


specified point in the story 


10. At the end of the story, how did Granny Gunn feel about her new 


home? 


She decided thc ghe Liked at ocPier alll 


Purpose: Literary Experience 
Process: Make Straightforward Inferences 


Description: Recognize and reproduce a character's feeling that is clearly suggested at a 


The answer shown illustrates the type of student response that would receive full credit (1 point). 


Percent 
Country 


Full Credit 


Benchmarking Participants 


Moscow City, Russian Fed. 97 (0.7) 
2 Madrid, Spain 94 (1.0) 
Ontario, Canada 93 (1.4) 
Norway (4) 92 (0.9) 
Andalusia, Spain 89 (1.2) 
= Quebec, Canada 89 (1.7) 
2 Denmark (3) 88 (1.6) 
Buenos Aires, Argentina 82 (2.2) 
Dubai, UAE 79 (1.6) 
Abu Dhabi, UAE 61 (2.6) 
Eng/Afr/Zulu - RSA (5) 51 (2.5) 


Percent significantly higher than international average 
Percent significantly lower than international average 


() Standard errors appear in parentheses. Because of roundina some results may appear inconsistent. 
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Exhibit 2.3.7: Low International Benchmark - Informational Example Item 1* 


p : Purpose: Acquire and Use Information 
Country F es Process: Focus on and Retrieve Explicitly Stated Information 
ull Credi 


Description: Retrieve and reproduce a detail from a chart 


Iran, Islamic Rep. of 86 (2.0) © 
Kuwait 122) © 
== 
Marecce 67 (2.4) 4. Look at the chart. 
Intemational Avg: S18 How much does an oxpecker weigh? 


Egypt 57 (2.1) @ 
South Africa 41 (1.9) @ oC O we Ces 


Benchmarking Participants 
Denmark (3) 92 (1.0) © 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


The answer shown illustrates the type of student response that would receive full credit (1 point). 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 
* Item administered only in PIRLS Literacy. 
See Appendix C.1 for target population coverage notes 1, 2, and 3. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.3.8: Low International Benchmark - Informational Example Item 2* 


Purpose: Acquire and Use Information 
Percent ; aa ; 
Country Full Credit Process: Focus on and Retrieve Explicitly Stated Information 
u 


Description: Retrieve and reproduce explicitly stated detail 


Kuwait 63 (2.6) © 

Iran, Islamic Rep. of 59 (25) © — 

Morocco 57 (2.0) © 11. What do rhinos do when they are trying to get rid of 
their ticks? 

Egypt 39 (2.0) @ 

South Africa 38 (1.9) @ They open ada tlot of time SC cotkching antes. 


Benchmarking Participants 
2 Denmark (3) 87 (1.4) © 


The answer shown illustrates the type of student response that would receive full credit (1 point). 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 
* Item administered only in PIRLS Literacy. 
See Appendix C.1 for target population coverage notes 1, 2, and 3. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Iran, Islamic Rep. of 


Benchmarking Participants 
2 Denmark (3) 


Exhibit 2.3.9: Low International Benchmark — Informational Example Item 3* 


Percent 


Correct 


Purpose: Acquire and Use Information 
Process: Make Straightforward Inferences 


Description: Make a straightforward inference about an action 


71 (2.7) © 
61(21) 0 _ —« 


International Avg. 57 (1.0) 


57 (1.7) 


6. Why do hunters want to kill rhinos? 


@ Rhinos are too dangerous. 


51 (2.4) @ 
44 (2.0) © 


Hunters want rhino meat. 


@ Hunters want rhino horns. 


95 (1.1) © 


* Item administered only in PIRLS Literacy. 


See Appendix C.1 for target population coverage notes 1, 2, and 3. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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© There are too many rhinos. 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Percent significantly higher than international average 
Percent significantly lower than international average 
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Exhibit 2.4: Intermediate International Benchmark (475) 


Exhibit 2.4 presents the description of student achievement at the Intermediate Benchmark, which 
is based on passages and items from both PIRLS and PIRLS Literacy. Because the scale anchoring 
descriptions are cumulative, with students’ comprehension processes building on skills demonstrated 
at the lower levels, as anticipated students at the Intermediate Benchmark demonstrated greater 
facility in retrieving explicitly stated information and making inferences as well as in interpreting 
and integrating story events and information. When reading literary texts, they showed an emerging 
ability to recognize language choices. 

Exhibits 2.4.1 through 2.4.12 present seven example items based on literary texts (“The 
Pearl,” “Flowers on the Roof? and “Macy”) and five example items based on informational texts 
(“Rhinos” and “The Green Sea Turtle’s Journey”). All five texts and their accompanying items and 
scoring guides are presented in Appendix H. Each exhibit shows achievement results either for 
the countries that participated in PIRLS Literacy (items from “The Pearl” or “Rhinos”), all the 
countries participating in PIRLS Literacy and PIRLS (items from “Flowers on the Roof”), or the 
countries that participated in PIRLS (for “Macy” and “The Green Sea Turtle’s Journey”). Up and 
down arrows indicate a significantly higher or lower percentage of success for the country compared 
to the international average on the item. The reading purpose, comprehension process, and scale 
anchoring description are provided above the item. For multiple-choice items, the correct response 
is indicated. Constructed response questions were worth 1, 2, or 3 points. Each constructed response 
item is shown with an illustrative student response and the amount of credit awarded the response 
is shown across the bottom of the exhibit, usually full credit. 

Example Items 2.4.1 and 2.4.2 show that fourth grade students at the Intermediate International 
Benchmark could provide two details in a constructed response format when asked about each 
of two different story events in “The Pearl” Example Item 2.4.3 shows they could provide one 
example out of two from the longer “Flowers on the Roof.’ They also could interpret and integrate 
information across “Flowers on the Roof” to identify the narrator of the story (Example 2.4.4). 
Based on the “Macy” story, they recognized the reason for a character’s action (Example Item 2.4.5), 
integrated evidence about a character's action (Example Item 2.4.6), and recognized how the author 
demonstrated a character's traits (Example 2.4.7). 

In reading the “Rhinos” PIRLS Literacy text, students reproduced an explicitly stated action 
from toward the end of the text (Example Item 2.4.8), made an inference about an explanation 
(Example 2.4.9), and interpreted information to provide a full explanation of why ticks cause a 
problem for rhinos (Example 2.4.10). In reading the PIRLS text about sea turtles, students made 
inferences to answer a multiple-choice item about the content of the first section of the text (Example 
2.4.11) and to answer a constructed response question about how people are making the sea more 
dangerous for turtles (Example Item 2.4.12). 
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Exhibit 2.4: Description of the PIRLS 2016 Intermediate International 
Benchmark (475) of Reading Achievement 


@ Intermediate International Benchmark 


47 5 When reading a mix of simpler and relatively complex Literary Texts, students can: 
* Independently locate, recognize, and reproduce explicitly stated actions, events, and feelings 
* Make straightforward inferences about the attributes, feelings, and motivations of main characters 
+ Interpret obvious reasons and causes, recognize evidence, and give examples 
* Begin to recognize language choices 


When reading a mix of simpler and relatively complex Informational Texts, students can: 


* Locate and reproduce two or three pieces of information from text 
* Make straightforward inferences to provide factual explanations 


* Begin to interpret and integrate information to order events 
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Exhibit 2.4.1: Intermediate International Benchmark - Literary Example Item 1° 


p ; Purpose: Literary Experience 
Country , ae Process: Focus on and Retrieve Explicitly Stated Information 
ull Credi <= : 


Description: Locate and reproduce 2 explicitly stated details 


Iran, Islamic Rep. of 60 (2.3) © 

Kuwait 52 (2.4) © — 

Morocco 51 (2.4) © 18. Reuben offers to give Josh two things. What are 
they? 

South Africa 38 (1.4) @ 

Egypt 30 (1.9) @ 1 New hove 


Benchmarking Participants 
2 Denmark (3) 83 (1.7) © 


2. Big shiny boat 


The answer shown illustrates the type of student response that would receive full credit (2 points). 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 
* Item administered only in PIRLS Literacy. 
See Appendix C.1 for target population coverage notes 1, 2, and 3. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.4.2: Intermediate International Benchmark - Literary Example Item 2* 


p ' Purpose: Literary Experience 
Country nia ‘ Process: Make Straightforward Inferences 
Full Credit 


Description: Make a straightforward inference and reproduce 2 of a character's actions 


Iran, Islamic Rep. of 55 (2.9) © 
Kuwait 44 (1.8) © | pemmee 
37 (0.9) 5. What does Reuben do differently after he gets the 
Egypt 36 (1.8) pearl? 
Morocco 28 (2.1) @ 
South Africa B14) © Write two things. 


@)1. Ke. Asean F pra wit Wis Edendy r 


Benchmarking Participants 
2 Denmark (3) 64 (2.1) © 


@o2. be ceeds ereoues eees. 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


The answer shown illustrates the type of student response that would receive full credit (2 points). 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 
* Item administered only in PIRLS Literacy. 
See Appendix C.1 for target population coverage notes 1, 2, and 3. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.4.3: Intermediate International Benchmark - Literary Example Item 3 


: 
Percent At - — 2 & 
country ) : 
Least 1 Point = 
1 
? Latvia 96 (0.9) 3 
2 Austria 96 (0.8) 3 
er ana an Write two ways in which Granny Gunn made her new flat feel like =| 
Norway (5) 95 (1.0) 2 
Ireland 95 (1.0) home: Wee hee + : 
Poland 95 (0.9) ; She ‘oro vg € Co F 
t Netherlands 94 (1.0) : 3 
Hungary 94 (1.3) a oO a Ww YY g 
Czech Republic 94 (1.0) £ 
Sweden 93 (1.2) 2. s 
Northern Ireland 92 (1.2) & 
Lithuania 92 (1.7) a 
Finland 91 (1.1) u 
Russian Federation 91 (1.1) 3 
2 Denmark 91 (13) ‘i 
Slovenia 90 (1.3) 
Slovak Republic 90 (1.4) 
2 Portugal 90 (1.5) 
12 Canada 90 (0.9) 
Australia 89 (1.3) 
2 t Hong Kong SAR 88 (1.6) 
France 88 (1.2) 
t United States 88 (1.6) 
Bulgaria 87 (1.5) 
Spain 87 (1.1) 
England 87 (1.4) 
Chinese Taipei 87 (1.7) 
Macao SAR 87 (1.2) 
3 Singapore 86 (1.2) 
Italy 85 (1.6) 
3 Israel 84 (1.3) 
New Zealand 84 (1.3) 
2 Belgium (French) 84 (1.6) The answer shown illustrates the type of student response that would receive partial credit (1 of 2 
Kazakhstan 82 (1.6) points). 
Germany 82 (1.7) 
702 
- Percent At 
Chile 77 (2.0) Country é 
5 . Least 1 Point 
Georgia 75 (2.0) @ 
Trinidad and Tobago 74 (2.1) @ 
Azerbaijan 68 (2.5) © Benchmarking Participants 
2 Malta 66 (2.0) @ Moscow City, Russian Fed. 97 (0.6) O 
Bahrain 64 (1.5) @ 2 Madrid, Spain 92 (1.1) © 
Saudi Arabia 59 (25) @ Ontario, Canada 90 (1.5) @ 
United Arab Emirates 56 (1.6) @ Norway (4) 89 (1.5) OO 
Iran, Islamic Rep. of 52 (2.0) @ = Quebec, Canada 85 (2.1) O 
Qatar 49 (1.2) @ Andalusia, Spain 84 (1.5) O 
Oman 46 (1.7) @ 2 Denmark (3) 80 (2.1) 
Kuwait 44 (2.0) @ Dubai, UAE 76 (1.2) @ 
Morocco 36 (1.6) @ Buenos Aires, Argentina 71 (2.5) @ 
Egypt 29 (16) @ Abu Dhabi, UAE 47 (2.7) © 
South Africa 22 (1.4) @ Eng/Afr/Zulu - RSA (5) 42 (2.6) @ 


© Percent significantly higher than international average 

@ Percent significantly lower than international average 
See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.4.4: Intermediate International Benchmark - Literary Example Item 4 


Purpose: Literary Experience 
Process: Interpret and Integrate Ideas and Information 


Description: Identify the narrator (in a first person story) from a range of clues in the text 
and confirmed by the pictures 


Country 


Ireland 
Russian Federation 
Northern Ireland 
Poland 
England 
2 Denmark 
Czech Republic 
Bulgaria 
Hungary 
Slovenia 
t Netherlands 
t United States 
2 Austria 
3 Singapore 
2 Latvia 
Australia 
Italy 
Finland 
Belgium (Flemish) 
12 Canada 
Israel 
Norway (5) 
Germany 
Slovak Republic 
Portugal 
Lithuania 
Azerbaijan 
Spain 
New Zealand 
Sweden 
Kazakhstan 
France 
1 Georgia 
2 t Hong Kong SAR 
Chile 


w 


N 


International Avg. | 75.(0.2) | 


Macao SAR 

2 Malta 

2 Belgium (French) 
Chinese Taipei 


Trinidad and Tobago 


Iran, Islamic Rep. of 


United Arab Emirates 


Qatar 
Bahrain 
Oman 
Morocco 
Kuwait 
Saudi Arabia 
South Africa 
Egypt 


coooooooooococoeoocooooooococeoceo 


©@D DODO OODHOOHOO® 


Who is telling the story? 


(@) a granny 


@ achild 
© a doctor 


©) a farmer 


Country 


Benchmarking Participants 
Moscow City, Russian Fed. 


= Quebec, Canada 
Ontario, Canada 

2 Madrid, Spain 
Andalusia, Spain 
Norway (4) 

2 Denmark (3) 
Dubai, UAE 


Buenos Aires, Argentina 
Eng/Afr/Zulu - RSA (5) 


Abu Dhabi, UAE 


Percent 


Correct 


96 (0.8) 
87 (1.7) 
86 (1.8) 
85 (1.4) 
79 (1.8) 
79 (1.7) 
79 (1.8) 
75 (1.4) 
67 (2.2) 
44 (3.1) 
43 (2.7) 


Percent significantly higher than international average 
Percent significantly lower than international average 


cocoocco 


@©@®@ 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.4.5: Intermediate International Benchmark - Literary Example Item 5 


: 
Country Percent TI Process: Make Straightforwardinferences——OCOCSCSCSCS 
puliae Description: Infer and recognize the reason for a character's action i 
Russian Federation 92 (0.9) O z 
Hungary 91 (1.2) O 3 
Ireland 91 (1.3) © 11. Why does Macy make white wings on a pole? g 
Northern Ireland 90 (1.3) © @ to look like hen’s feathers 2 
Finland 90 (1.1) O & 
t Netherlands 90 (1.4) O to make a decision g 
® Singapore a i1.2) © @ to look like an owl is 
Norway (5) 89 (1.3) O g 
t United States 39 (1.6) @ ©) toimpress Sam E 
Czech Republic 89 (1.2) 
England 88 (1.2) © & 
Poland 87 (14) © fr 
2 Austria 87 (13) O 8 
Australia 87 (13) O 3 
Slovak Republic 87 (1.7) © 7 
2 Denmark 87 (14) O 
2 +t Hong Kong SAR 86 (17) O 
Sweden 86 (1.7) © 
Chinese Taipei 85 (1.3) © 
12 Canada 85 (1.1) © 
Italy 85 (1.6) O 
Belgium (Flemish) 84 (1.7) © 
Slovenia 84 (1.7) O 
New Zealand 84 (1.5) O 
2 Latvia 84 (18) © 
Bulgaria 84 (1.8) © 
Lithuania 83 (2.0) © 
Germany 83 (16) O 
Macao SAR 81 (1.8) 
Spain 79 (1.6) 
Kazakhstan 78 (1.7) 
France 78 (1.8) 
: Portugal 76 (1.7) ae 
Israel 76 (1.8) Country 
“ Correct 
Azerbaijan 2B (2.1) @ 
Chile 72 (2.0) @ 
Trinidad and Tobago 71 (1.8) © Benchmarking Participants 
2 Belgium (French) 70 (2.1) @ Moscow City, Russian Fed. 94 (0.9) O 
2 Malta 64 (2.1) @ Ontario, Canada 84 (2.0) © 
1 Georgia 63 (2.7) @ = Quebec, Canada 84 (2.5) 
Iran, Islamic Rep. of 62 (2.7) @ 2 Madrid, Spain 82 (1.8) 
Qatar 59 (1.5) @ Norway (4) 80 (1.5) 
United Arab Emirates 58 (15) @ Andalusia, Spain 78 (1.8) 
Bahrain 58 (1.9) @ Dubai, UAE 78 (1.5) 
Oman 51 (17) @ Buenos Aires, Argentina 63 (2.2) @ 
Saudi Arabia 50 (2.1) @ Eng/Afr/Zulu - RSA (5) 57 (2.7) @ 
Morocco 44 (2.5) @ Abu Dhabi, UAE 49 (2.5) @ 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 
See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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N 


N 


Country 


Russian Federation 
Chinese Taipei 


2 + Hong Kong SAR 


Macao SAR 

3 Singapore 

2 Latvia 

Poland 

Ireland 

Finland 

t United States 
Sweden 
England 
Lithuania 
Bulgaria 
Austria 
Australia 

Italy 

Northern Ireland 
Germany 
Slovak Republic 
Canada 
Slovenia 

New Zealand 
Hungary 

Czech Republic 
Kazakhstan 

2 Denmark 
Belgium (Flemish) 


International Avg. 710 (06)) 


t Netherlands 
Norway (5) 

3 Israel 

Chile 

Spain 


Trinidad and Tobago 


1 Georgia 

France 

2 Portugal 
Azerbaijan 

2 Belgium (French) 
Qatar 

2 Malta 

Bahrain 


United Arab Emirates 
Iran, Islamic Rep. of 


Saudi Arabia 
Oman 
Morocco 
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12. Macy “hit the wings with her hands and pushed the wings away.” 


What does Macy want the hen to think? 


Exhibit 2.4.6: Intermediate International Benchmark - Literary Example Item 6 


Purpose: Literary Experience 
Process: Interpret and Integrate Ideas and Information 


Description: Integrate evidence to recognize the reason for a character’s action 


e that Macy is saving the hen 


that Macy is angry with the hen 


© that Macy is terrified of the owl 


© that Macy is playing with the owl 


Country 


Benchmarking Participants 
Moscow City, Russian Fed. 


Ontario, Canada 
= Quebec, Canada 
2 Madrid, Spain 

Dubai, UAE 

Norway (4) 

Andalusia, Spain 


Buenos Aires, Argentina 


Abu Dhabi, UAE 


Eng/Afr/Zulu - RSA (5) 


Percent significantly higher than international average 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Percent 


Correct 


93 (1.1) 
74 (2.2) 
72 (2.6) 
71 (1.8) 
71 (1.6) 
64 (2.1) 
63 (2.4) 
62 (2.2) 
46 (2.5) 
44 (2.3) 


Percent significantly lower than international average 
See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 2.4.7: Intermediate International Benchmark - Literary Example Item 7 


Country recent IT Process: Evaluate and Critique Contentand TetualElements Si 
Description: Recognize how an author demonstrates a character's traits ii 
Russian Federation 96 (0.8) z 
Hungary 94 (1.0) 3 
Ireland 90 (1.3) How does the author show you what the red hen is like? g 
JEIUES ES) aot) @™ by describing what the red hen looks like 2 
2 Latvia 89 (1.2) & 
Poland 89 (1.5) by describing the red hen’s favorite food z 
Finland —_ oe) © by describing where the red hen lives 2 
Chinese Taipei 88 (1.2) 2 
Lithuania 88 (1.3) e@ by describing how the red hen behaves s 
2 +t Hong Kong SAR 87 (1.8) g 
Sweden 87 (1.6) & 
Italy 87 (1.4) a 
2 Denmark 87 (1.6) 8 
Macao SAR 87 (1.6) 3 
2 Austria 86 (1.5) 7 
t United States 86 (1.6) 
England 86 (1.2) 
Slovak Republic 86 (1.7) 
3 Israel 85 (1.4) 
3 Singapore 85 (1.1) 
Bulgaria 85 (1.8) 
Australia 84 (1.7) 
Northern Ireland 84 (1.4) 
t Netherlands 84 (1.7) 
12 Canada 84 (1.1) 
Germany 84 (1.6) 
New Zealand 83 (1.5) 
France 82 (1.7) 
Czech Republic 82 (1.7) 
Spain 82 (1.2) 
1 Georgia 82 (1.9) 
Slovenia 80 (2.0) 
Kazakhstan 80 (1.6) 
Portugal 75 (1 7) ® Country cae 
2 Belgium (French) 72 (2.0) @ 
Azerbaijan 72 (2.2) @ 
Belgium (Flemish) 70 (2.0) © Benchmarking Participants 
Chile 69 (16) ®  MoscowCity,RussianFed. 97 (0.7) O- 
Trinidad and Tobago 66 (2.1) @ 2 Madrid, Spain 85 (1.5) O 
2 Malta 63 (24) @ = Quebec, Canada 84 (2.5) 
Saudi Arabia 63 (2.1) @ Ontario, Canada 83 (2.3) 
Bahrain 62 (1.7) @ Andalusia, Spain 81 (1.9) 
Qatar 62 (1.5) @ Norway (4) 77 (2.1) 
United Arab Emirates 61 (13) @ Dubai, UAE 76 (1.6) 
Iran, Islamic Rep. of 59 (3.0) @ Abu Dhabi, UAE 54 (2.2) @ 
Oman 54 (1.6) @ Buenos Aires, Argentina 52 (2.3) @ 
Morocco 34 (2.2) @ Eng/Afr/Zulu - RSA (5) 51 (2.1) @ 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.4.8: Intermediate International Benchmark — Informational 


Example Item 1* 
p ; Purpose: Acquire and Use Information 
Country E ae Process: Focus on and Retrieve Explicitly Stated Information 
ull Credi 


Description: Retrieve and reproduce an explicitly stated action 


Iran, Islamic Rep. of 62 (3.0) © 

Kuwait 221) 9 | — 

Morocco 47 (2.1) 16. What does the oxpecker do to warn the rhino 
of danger? 

Egypt 40 (1.8) @ 


South Africa 24(13) © it makes loud noises and Nisses 


Benchmarking Participants 
2 Denmark (3) 83 (1.5) O 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


The answer shown illustrates the type of student response that would receive full credit (1 point). 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 
* Item administered only in PIRLS Literacy. 
See Appendix C.1 for target population coverage notes 1, 2, and 3. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.4.9: Intermediate International Benchmark - Informational 


Example Item 2* 
pane Purpose: Acquire and Use Information 
Country pees Process: Make Straightforward Inferences 
orre 


Iran, Islamic Rep. of 62 (2.4) © 
Kuwait 51 (23) © ; 
International Avg. 47 (0.9) 8. Why are trees and bushes a good place for ticks to 
South Africa 8B (13) © hide? 
Egypt 39 (17) @ 
WGTOCES 38 (20) © @) because ticks eat, grass and leaves 
@ because rhinos come there to eat 
Benchmarking Participants 
2 Denmark (3) 78 (2.0) © © because the birds want to eat the ticks 


©) because the leaves protect their skin 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 
* Item administered only in PIRLS Literacy. 
See Appendix C.1 for target population coverage notes 1, 2, and 3. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.4.10: Intermediate International Benchmark - Informational 


Example Item 3* 
Purpose: Acquire and Use Information 


Country ae Process: pOteTRIE Elite! |___ Process: Interpret and Integrate ldeasand information Ideas and jam rocese incon tetan ol inenieteldessebd one 
Iran, Islamic Rep. of 52 (2.2) O 
Kuwalt 38 7 7 0 >h—_ 


9. Explain why ticks are a problem for rhinos. 
Egypt 29 oi @ — . ; ' 
sai y \ he ticks suck the chinos 


Morocco 28 (18) @ 
South Africa 19 (1.2) @ 


blood and make the chinos 


Benchmarking Participants 


® Denmark (3) 3919) O Geel itchy. 


The answer shown illustrates the type of student response that would receive full credit (2 points). 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 
* Item administered only in PIRLS Literacy. 
See Appendix C.1 for target population coverage notes 1, 2, and 3. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Example Item 4 


Russian Federation 
Czech Republic 


Belgium (Flemish) 


2 t Hong Kong SAR 


Chinese Taipei 
Slovak Republic 


Northern Ireland 


t United States 


International Avg. 84 (0.2) 


Trinidad and Tobago 
2 Belgium (French) 


United Arab Emirates 
Iran, Islamic Rep. of 


Downloaded from http://pirls2016.org/download-center/ 


©®©@D@OD@D OD OOOOH OHO®O 


8 
® 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Benchmarking Participants 
Moscow City, Russian Fed. 
2 Madrid, Spain 
Ontario, Canada 


= Quebec, Canada 
Andalusia, Spain 


Abu Dhabi, UAE 
Buenos Aires, Argentina 
Eng/Afr/Zulu - RSA (5) 


Percent significantly higher than international average 
Percent significantly lower than international average 


Exhibit 2.4.11: Intermediate International Benchmark - Informational 


Purpose: Acquire and Use Information 
Process: Make Straightforward Inferences 


Description: Recognize the main idea of a specified section of the text 


What is the first section “Out From the Sand” about? 
@) what different sea turtles look like 

how sea turtles learn to swim 
© what sea turtles like to eat 


e@ how sea turtles’ eggs hatch 


Percent 


Correct 


94 (0.9) 
89 (1.4) 
89 (1.5) 
87 (1.8) 
85 (2.3) 
83 (1.8) 
82 (1.3) 
60 (2.3) 
58 (1.9) 
56 (2.3) 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Example Item 5 


Country 


Russian Federation 
Chinese Taipei 
2 t Hong Kong SAR 


Finland 


3 Singapore 
Norway (5) 


Sweden 
Ireland 


Macao SAR 


Germany 
Australia 
Bulgaria 
Hungary 
2 Denmark 


t Netherlands 


2 Austria 
2 Latvia 
12 Canada 
Slovenia 

Spain 
England 


Czech Republic 
Kazakhstan 
New Zealand 


Italy 
2 Portugal 


t United States 
Northern Ireland 


3 Israel 
Lithuania 
France 


Belgium (Flemish) 


International Avg. ya (\)) 


Slovak Republic 


Poland 


Trinidad and Tobago 


2 Malta 


2 Belgium (French) 


Chile 
1 Georgia 


Azerbaijan 
United Arab Emirates 


Qatar 


Iran, Islamic Rep. of 


Bahrain 
Oman 
Morocco 


Saudi Arabia 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Full Credit 


° 
° 
° 
3° 
3° 
° 
3° 
° 
° 
° 
° 
° 
3° 
3° 
° 
° 
3° 
° 
3° 
3° 
3° 
° 
3° 
° 
° 
° 
° 
3° 
° 
3° 
° 
° 


Exhibit 2.4.12: Intermediate International Benchmark — 


Purpose: Acquire and Use Information 
Process: Make Straightforward Inferences 


Description: Make a straightforward inference about the cause of a situation 


Informational 


6. According to the article, what is one way people have made the sea 
more dangerous for turtles? 


Peogle eut plastic UN Whe Seu 


Country 


2 Madrid, Spain 

= Quebec, Canada 
Andalusia, Spain 
Ontario, Canada 
Norway (4) 
Dubai, UAE 


Abu Dhabi, UAE 


®@@DODDODOHHDHDODHOHOO®O 


Benchmarking Participants 
Moscow City, Russian Fed. 


Buenos Aires, Argentina 


Eng/Afr/Zulu - RSA (5) 


The answer shown illustrates the type of student response that would receive full credit (1 point). 


Percent 


Full Credit 


94 (0.9 
83 (1.7 
80 (1.9 
80 (2.2 
77 (2.4 
75 (2.1 
66 (1.4 
45 (2.2 
41 (2. 


) 
) 
) 
) 
) 
) 
) 
) 
6) 
30 (2.4) 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 2.5: High International Benchmark (550) 


Exhibit 2.5 contains the description of comprehension skills and strategies demonstrated by fourth 
grade students at the High International Benchmark. At the High International Benchmark, students 
demonstrated that they could locate and distinguish information embedded in dense text; make 
inferences to explain relationships and reasons; interpret and integrate events and information across 
text; and evaluate language features and textual elements. 

Exhibits 2.5.1 through 2.5.10 contain examples of the types of items successfully answered by 
students achieving at the High International Benchmark, including two based on the literary text 
“Flowers on the Roof,’ four based on the literary text “Macy,” and four based on the informational 
text “The Green Sea Turtle’s Journey” (see Appendix H). Each exhibit shows achievement results 
for the countries that participated in PIRLS (and also the PIRLS Literacy countries for “Flowers on 
the Roof), with up and down arrows indicating a significantly higher or lower percentage of success 
than the international average. The reading purpose, comprehension process, and scale anchoring 
description are provided above the item. For multiple-choice items, the correct response is indicated. 
Constructed response questions were worth 1, 2, or 3 points. Each constructed response item is 
shown with an illustrative student response and the amount of credit awarded the response is shown 
across the bottom of the exhibit, usually full credit. 

Based on two constructed response items from “Flowers on the Roof, Example Item 2.5.1 
shows that students reaching the High International Benchmark could infer the significance of a 
character's action and Example Item 2.5.2 that they could give a partial interpretation of a character's 
feelings. Example Item 2.5.3 illustrates the kinds of information students were able to retrieve from 
the “Macy” passage, and Example 2.5.4 shows they could recognize the reason for a character’s 
action. In Example Items 2.5.5 and 2.5.6, students demonstrated that they were able to integrate 
events across the story to predict a character's behavior and to describe a central idea in the story. 

Example Items 2.5.7 and 2.5.8 show that when reading “The Green Sea Turtle’s Journey,” 
students were able to reproduce explicitly stated details from dense informational text. They also 
were able to make an inference to provide two explanations (Example Item 2.5.9). Perhaps most 
interesting, in Example Item 2.5.10, students at the High International Benchmark were able to 
evaluate the content of the diagram to interpret its meaning. 
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Exhibit 2.5: Description of the PIRLS 2016 High International Benchmark (550) 
of Reading Achievement 


Ce High International Benc 


5 5 @) When reading relatively complex Literary Texts, students can: 


* Locate and distinguish significant actions and details embedded across the text 


+ Make inferences to explain relationships between intentions, actions, events, and feelings, and 
give text-oased support 


+ Interpret and integrate story events and character actions, traits, and feelings as they develop 
across the text 


* Recognize the use of some language features (e.g., metaphor, tone, imagery) 


When reading relatively complex Informational Texts, students can: 


+ Locate and distinguish relevant information within a dense text or a complex table 


+ Make inferences about logical connections to provide explanations and reasons 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


+ Integrate textual and visual information to interpret the relationship between ideas 
* Evaluate and make generalizations about content and textual elements 
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( 


Northern Ireland 


Russian Federation 


Belgium (Flemish) 


Czech Republic 
Chinese Taipei 
+ United States 


2 + Hong Kong SAR 


Slovak Republic 


International Avg. 61 (0.3) 


2 Belgium (French) 


Nn 


Trinidad and Tobago 
Iran, Islamic Rep. of 


United Arab Emirates 


Downloaded from http://pirls2016.org/download-center/ 


® 
® 
® 
® 
® 
® 
® 
® 
® 
® 
® 
® 
® 
® 
® 


° 
® 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Exhibit 2.5.1: High International Benchmark - Literary Example Item 1 


Purpose: Literary Experience 
Process: Make Straightforward Inferences 


Description: Infer the significance of a character’s action from subsequent events 


Find the part of the story by this picture of Granny Gunn: 
Why did Granny Gunn wink and grin at the little boy? 


Because the 


Oo good 


Benchmarking Participants 
Moscow City, Russian Fed. 
= Quebec, Canada 
2 Madrid, Spain 
Ontario, Canada 
Andalusia, Spain 


Buenos Aires, Argentina 


Abu Dhabi, UAE 
Eng/Afr/Zulu - RSA (5) 


Percent significantly higher than international average 
Percent significantly lower than international average 


The answer shown illustrates the type of student response that would receive full credit (1 point). 


Percent 


Full Credit 


85 (1.4 
80 (1.8 
79 (1.9 
72 (2.2 
65 (2.1) 
65 (2.1) 
63 (2.1) 
56 (2.3) 
54 (1.5) 
28 (2.3) 
25 (2.4) 


) 
) 
) 
) 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


child Be ci Ve 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 2.5.2: High International Benchmark - Literary Example Item 2 


Country 


Northern Ireland 74 (1.6 
2 Latvia 74 (1.7 
Ireland 23 (2.4) 
Norway (5) 70 (1.6 
2 Denmark 67 (2.0 
Russian Federation 66 (1.9 
Poland 66 (2.2 

2 Austria 65 (1.8 
Australia 64 (2.1 
England 63 (1.9 
12 Canada 62 (1.6 
t United States 61 (2.4) 
Hungary 61 (2.3 
t Netherlands 61 (2.0 
Sweden 60 (2.0 
Italy 60 (2.1 
Slovak Republic 59 (1.8 
New Zealand 59 (1.8 
2 Portugal 59 (1.9 
Spain 57 (1.2 
Belgium (Flemish) 57 (1.9 
Germany 57 (2.2 
Bulgaria 56 (2.3 
France 54 (2.2 
Finland 53 (2.2 
Lithuania 53 (1.9 
Czech Republic 52 (1.6 
3 Israel 51 (2.1 
2 Belgium (French) 51 (1.9 
' Georgia 51 (2.5 
9.03 
Slovenia 45 (2.1 
3 Singapore 44 (1.7 
Macao SAR 43 (1.8 

2 Malta 42 (2.0 
Kazakhstan 42 (2.2 
Chile 40 (2.0 
2 +t Hong Kong SAR 39 (2.2 
Chinese Taipei 37 (2.0 
Iran, Islamic Rep. of 37 (1.9 
Trinidad and Tobago 36 (2.2 
Saudi Arabia 34 (23 
Azerbaijan 33 (18 
Qatar 25 (1.4) 
United Arab Emirates 24 (0.9 
Kuwait 23 (1.7 
Oman 20 (1.1 
Bahrain 20 (1.3 
Egypt 14 (1.2 
South Africa 11 (1.0 
Morocco 10 (1.0 


Percent At 


Least 1 Point 


cooococoooooocoocoooocoocooocco 


@ |The answer shown illustrates the type of student response that would receive partial credit (1 of 2 


Purpose: Literary Experience 
Process: Interpret and Integrate Ideas and Information 


Description: Give a simple interpretation of a character's feelings about the settings 


a 
vi 


When Granny Gunn was on the balcony, she crouched down so that 


she could not see any of the rooftops—only the mountains and the 
sky. Why did she do this? 


@ Se 


She 


Cour 


see 


+nwe 


Countryside 


® |points). 


@©DOODHDOGDHODOOHDOHDHOHHDHOO®O 


° 
® 


Country 


Benchmarking Participants 

Moscow City, Russian Fed. 

2 Madrid, Spain 

= Quebec, Canada 
Ontario, Canada 
Norway (4) 
Andalusia, Spain 

2 Denmark (3) 
Dubai, UAE 
Buenos Aires, Argentina 
Eng/Afr/Zulu - RSA (5) 
Abu Dhabi, UAE 


Percent At 


Least 1 Point 


80 (1.7) 
62 (2.0) 
60 (2.8) 
59 (3.1) 
58 (2.6) 
58 (2.0) 
) 
) 
) 
) 
) 


cococo 


49 (2.3 
40 (1.9 
37 (2.4 
21 (2.4 
19 (1.8 


©@@O@ 


Percent significantly higher than international average 


Percent significantly lower than international average 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Downloaded from http://pirls2016.org/download-center/ 
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Exhibit 2.5.3: High International Benchmark - Literary Example Item 3 


Country 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


Percent 


Full Credit 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Downloaded from http://pirls2016.org/download-center/ 


TIMSS & PIRLS 


Grade 


Purpose: Literary Experience 
Process: Focus on and Retrieve Explicitly Stated Information 


Description: Locate and reproduce 2 actions that lead to a specified result 


Chinese Taipei 76 (1.9) © 
3 Singapore 4(16) 0 | —, ; 

2 t Hong Kong SAR 74(20) © 6. Macy wants the red hen to go into the cage. 
Russian Federation 67 (2.1) © What are two things Macy does that do not work? 
nih -_ ~ 5 A) She tris +o Pick vp the 

t Netherlands 63 (2.4) © hen 
Ireland 63 (2.1) @ , 
Norway (5) 62 (24) @ C)2. She PrtS Pood wm the hen's 
England 62 (1.9) © cage 
Italy 61 (2.3) @ 
Bulgaria 60 (2.5) © 
2 Denmark 58 (2.1) @ 
2 Portugal 58 (1.9) © 
Macao SAR 57 (2.1) @ 

12 Canada 57 (1.2) © 
Sweden 57 (23) © 
Lithuania 56 (2.5) O 

t United States 55 (23) © 
Slovak Republic 55 (2.1) © 

2 Austria 54 (2.3) © 
Germany 53 (2.2) O 
Czech Republic 53 (2.2) © 
Belgium (Flemish) 52 (1.8) O 
New Zealand 52 (1.9) 

Slovenia 52 (2.3) 

3 Israel 49 (2.3) 
8.03 
France 48 (2.3) 
Finland 48 (2.1) 
Australia 47 (2.1) 

2 Latvia 47 (2.4) The answer shown illustrates the type of student response that would receive full credit (2 points). 

Spain 47 (1.8) 
Trinidad and Tobago 46 (1.9) 
Percent 
Poland 42 (2.2) @ Country Full Credit 
2 Belgium (French) 40 (2.0) @ 
Kazakhstan 38 (2.1) @ 
Chile 37 (2.4) © Benchmarking Participants 

2 Malta 32 (2.4) @ Moscow City, Russian Fed. 82 (1.5) O 
Bahrain 28 (2.1) @ Ontario, Canada 57 (2.4) © 
United Arab Emirates 28 (1.1) @ = Quebec, Canada 56 (2.7) O 
Saudi Arabia 28 (2.2) @ Norway (4) 53 (2.1) © 
Oman 27 (1.5) @ 2 Madrid, Spain 53 (2.1) 

' Georgia 26 (2.0) @ Andalusia, Spain 45 (1.9) 
Iran, Islamic Rep. of 25 (2.4) @ Buenos Aires, Argentina 42 (18) @ 
Qatar 25 (1.2) @ Dubai, UAE 42 (14) @ 
Azerbaijan 17 (1.5) @ Eng/Afr/Zulu - RSA (5) 20 (2.1) @ 
Morocco 1(04) @ Abu Dhabi, UAE 20 (1.9) @ 


Fg 
g IEA International Study Center 
_— 


Lynch School of Education 
BOSTON COLLEGE 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 2.5.4: High International Benchmark - Literary Example Item 4 


Percent 


Country 


Russian Federation 85 (1.5) 
Hungary 72 (2.1) 
Spain 72 (1.6) 
Chinese Taipei 70 (1.8) 
Lithuania 68 (2.1) 
Poland 67 (2.1) 
Bulgaria 67 (2.4) 

2 +t Hong Kong SAR 66 (2.5) 
Italy 65 (2.1) 
Slovak Republic 65 (2.0) 
Macao SAR 63 (1.7) 

2 Latvia 63 (2.3) 
Norway (5) 63 (2.2) 
Azerbaijan 63 (2.2) 
France 62 (2.3) 

2 Portugal 61 (2.0) 
Kazakhstan 60 (2.2) 
Czech Republic 60 (1.8) 
lreland 57 (2.3) 

t Netherlands 57 (1.8) 
Sweden 56 (2.1) 
Slovenia 56 (2.2) 

2 Denmark 56 (2.1) 
2 Malta 55 (2.2) 
Belgium (Flemish) 55 (2.2) 

2 Austria 55 (2.3) 
2 Belgium (French) 55 (2.3) 
1 Georgia 55 (2.3) 
3 Israel 54 (2.0) 
Northern Ireland 53 (2.1) 
Germany 53 (2.2) 
England 53 (1.5) 
12 Canada 52 (1.7) 
Finland 51 (2.1) 

t United States 51 (2.2) 
3 Singapore 48 (1.7) 
Australia 47 (2.1) 
Iran, Islamic Rep. of 47 (2.7) 
New Zealand 47 (2.0) 
Chile 39 (2.3) 
United Arab Emirates 37 (1.2) 
Qatar 37 (1.2) 
Saudi Arabia 37 (2.0) 
Bahrain 34 (1.9) 
Trinidad and Tobago 30 (1.9) 
Oman 24 (1.5) 
Morocco 21 (1.8) 


Correct 


ES 
9. | Why does Mum say, “I would like your job”? 


@) Mum feels sorry for Macy. 
Macy should do more jobs around the house. 
© Mum really likes looking after hens. 


e Macy should understand Mum has harder jobs. 


cooococoooocococcococo 


Percent 
Country 

Correct 
® 
® Benchmarking Participants 
®@ Moscow City, Russian Fed. 85 (1.4) © 
® 2 Madrid, Spain 80 (2.1) © 
® Andalusia, Spain B (2.0) © 
® = Quebec, Canada 57 (2.4) 
® Ontario, Canada 53 (2.4) 
® Buenos Aires, Argentina 51 (2.6) 
® Norway (4) 46 (2.0) @ 
®@ Dubai, UAE 45 (16) @ 
®@ Abu Dhabi, UAE 31(1.9) @ 
@ Eng/Afr/Zulu - RSA (5) 22 (1.5) @ 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 


Purpose: Literary Experience 
Process: Make Straightforward Inferences 


Description: Make a straightforward inference about the reason for a character’s words 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Downloaded from http://pirls2016.org/download-center/ 
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Exhibit 2.5.5: High International Benchmark - Literary Example Item 5 


Country 


Finland 
Russian Federation 
Lithuania 

2 Latvia 
Ireland 
Sweden 

3 Singapore 
Norway (5) 
Poland 
England 
Australia 
Hungary 

2 +t Hong Kong SAR 

Northern Ireland 
Italy 
Czech Republic 

t United States 

t Netherlands 
Chinese Taipei 
Germany 
Spain 
Kazakhstan 
Slovenia 

12 Canada 

2 Denmark 
Bulgaria 
Slovak Republic 

2 Austria 
Belgium (Flemish) 
New Zealand 
Macao SAR 
France 


International Avg. Vl (I)) 


3 Israel 

2 Portugal 

2 Belgium (French) 
Trinidad and Tobago 
Chile 

2 Malta 
Azerbaijan 

1 Georgia 
Iran, Islamic Rep. of 
United Arab Emirates 
Bahrain 
Qatar 
Oman 
Saudi Arabia 
Morocco 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Downloaded from http://pirls2016.org/download-center/ 


©@D DODO OOOOH O®O 


Purpose: Literary Experience 
Process: Interpret and Integrate Ideas and Information 


Description: Integrate events across the text to predict a character’s future behavior 


[= —————————7 
15. What do you think the red hen will do next time Macy puts the hens 
in their cage? 


She voll just git down 


Wiacy comes and picks her up. 


Country 


Benchmarking Participants 
Moscow City, Russian Fed. 
= Quebec, Canada 
2 Madrid, Spain 


Andalusia, Spain 
Ontario, Canada 
Norway (4) 
Dubai, UAE 


Buenos Aires, Argentina 
Eng/Afr/Zulu - RSA (5) 


Abu Dhabi, UAE 


The answer shown illustrates the type of student response that would receive full credit (1 point). 


Percent 


Full Credit 


91 (1.1) 
76 (2.1) 
76 (2.1) 
69 (2.3) 
63 (3.0) 
61 (2.1) 
57 (2.6) 
49 (2.4) 
30 (2.3) 
28 (2.6) 


Percent significantly higher than international average 
Percent significantly lower than international average 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 2.5.6: High International Benchmark — Literary Example Item 6 


Purpose: Literary Experience 
Process: Interpret and Integrate Ideas and Information 


Country 


Russian Federation 


Australia 
Germany 
Poland 
England 
Lithuania 
Ireland 
Hungary 

2 Austria 
Finland 

t United States 
Belgium (Flemish) 
Norway (5) 
Northern Ireland 

2 +t Hong Kong SAR 

New Zealand 

t Netherlands 
Chinese Taipei 

12 Canada 

Bulgaria 
Czech Republic 

3 Singapore 
Sweden 
Slovenia 
Italy 

2 Latvia 

2 Denmark 
Macao SAR 


International Avg. 43 (0.3) 


Spain 

Slovak Republic 
3 Israel 
2 Portugal 


Trinidad and Tobago 


Kazakhstan 

2 Belgium (French) 
France 
Chile 


Iran, Islamic Rep. of 
United Arab Emirates 


Bahrain 
Qatar 

1 Georgia 
Azerbaijan 

2 Malta 
Oman 
Saudi Arabia 
Morocco 


©®@D OH @D @ OOD OOOH OHHODO®O 


8 
® 


Description: Integrate evidence from across the text to describe a central idea 


14. Why is Macy at the top of the pecking order at the end of the story? 


Use the information from the story to explain your answer. 


She tricked the nen se “he nen 


thovynt Macy Was bettec 


Country 


Benchmarking Participants 
Moscow City, Russian Fed. 
2 Madrid, Spain 


Ontario, Canada 


= Quebec, Canada 


Norway (4) 
Andalusia, Spain 
Dubai, UAE 


Buenos Aires, Argentina 


Abu Dhabi, UAE 
Eng/Afr/Zulu - RSA (5) 


Percent 


Full Credit 


74 (1.5) 
54 (2.1) 
51 (2.4) 
48 (2.9) 
45 (2.2) 
Al (2.5) 
38 (1.5) 
26 (2.0) 
16 (1.8) 
11 (1.6) 


Percent significantly higher than international average 
Percent significantly lower than international average 


oco 


@@oO® 


The answer shown illustrates the type of student response that would receive full credit (1 point). 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.5.7: High International Benchmark - Informational Example Item 1 


Country jeer JP Process: Focus on and Retrieve Explicit Statedinformation_——SSSSSCS~S~ 
: 
Chinese Taipei 74 (20) a 
Finland 69 (20) © | —_ > 
Russian Federation 68 (19) © 2. “One of the baby sea turtles begins to stir and hatch from her egg.” & 
Ireland 66 (2.1) O Write the first two things the hatchling does next. 2 
Hungary 65 (2.0) O G 
England 63 (18) © Ai. The opens he 249- F 
Norway (2) eS 2 She oreaksS out of the shell. bE: 
Sweden 61 (2.4) © 2 
2 + Hong Kong SAR 61 (2.4) © £ 
Lithuania 60 (2.6) © 4 
Belgium (Flemish) 60 (1.9) © é 
Macao SAR 60 (1.8) © 3 
Germany 59 (2.2) © u 
t Netherlands 59 (2.2) @ 3 
2 Portugal 59 (18) © ° 
Australia 58 (2.1) © 
12 Canada 58 (1.7) © 
Northern Ireland 58 (2.4) © 
2 Austria 58 (2.5) O 
Slovenia 57 (2.6) © 
Slovak Republic 57 (1.8) © 
Czech Republic 57 (2.1) © 
t United States 56 (18) O 
Bulgaria 55 (25) 
3 Israel 55 (2.1) 
Spain 55 (15) © 
3 Singapore 54 (1.7) 
France 53 (2.4) 
New Zealand 52 (2.0) 
2 Latvia 52 (2.1) 
2 Denmark 52 (2.3) 
Italy 51 (2.2) The answer shown illustrates the type of student response that would receive full credit (2 points). 
Poland 47 (2.6) 
7 " Percent 
Belgium (French) 47 (19) @ Country Full Credit 
Kazakhstan 46 (1.7) @ 
Bahrain 43 (2.0) @ 
Trinidad and Tobago 40 (2.1) © Benchmarking Participants 
1 Georgia 40 (2.7) @ Moscow City, Russian Fed. 75 (1.8) © 
Oman 38 (1.7) @ = Quebec, Canada 63 (2.1) O 
Azerbaijan 34 (2.3) @ 2 Madrid, Spain 56 (1.7) © 
Iran, Islamic Rep. of 33 (2.7) @ Ontario, Canada 55 (4.1) 
2 Malta 33 (2.1) @ Norway (4) 51 (2.1) 
United Arab Emirates 32 (1.1) @ Andalusia, Spain 49 (2.6) 
Qatar 31 (1.2) @ Dubai, UAE 47 (1.9) @ 
Chile 28 (2.0) @ Buenos Aires, Argentina 40 (2.4) @ 
Morocco 10 (1.6) @ Abu Dhabi, UAE 24 (2.0) @ 
Saudi Arabia 9(14) @ Eng/Afr/Zulu - RSA (5) 17 (23) @ 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 
See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


TIMSS & PIRLS 
IEA International Study Center 


ZB 
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Exhibit 2.5.8: High International Benchmark - Informational Example Item 2 


Purpose: Acquire and Use Information 
Process: Focus on and Retrieve Explicitly Stated Information 


Description: Locate and reproduce an explicitly stated detail 


Country 


Chinese Taipei 
Finland 

Russian Federation 
Hong Kong SAR 
Kazakhstan 


+ 


w 


Singapore 
Macao SAR 
Norway (5) 
Latvia 
Ireland 
Sweden 
Lithuania 
Bulgaria 
Denmark 
Slovak Republic 
Belgium (Flemish) 
England 
Netherlands 
Czech Republic 
Northern Ireland 
Hungary 
Germany 
Italy 
Poland 
3 Israel 
Australia 
12 Canada 
Slovenia 
2 Austria 


N 


N 


= 


t United States 
France 
New Zealand 
Azerbaijan 

2 Portugal 

1 Georgia 

2 Belgium (French) 
Trinidad and Tobago 
Spain 
United Arab Emirates 
Bahrain 
Chile 

2 Malta 
Iran, Islamic Rep. of 
Qatar 
Saudi Arabia 
Oman 
Morocco 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Percent 


Full Credit 


80 (1.9) 
76 (1.7) 
74 (1.6) 
73 (2.5) 
72 (1.9) 
70 (1.5) 
68 (2.1) 
68 (2.0) 
68 (2.6) 
67 (2.1) 
66 (2.6) 
64 (2.6) 
63 (2.6) 
63 (2.5) 
62 (2.0) 
62 (2.1) 
62 (1.9) 
61 (2.2) 
61 (2.1) 
60 (2.3) 
59 (2.4) 
59 (2.2) 
58 (2.4) 
57 (2.1) 
55 (2.1) 
55 (2.0) 
55 (1.1) 
55 (2.0) 
54 (2.4) 


52 (2.2) 
49 (2.5) 
49 (2.2) 
45 (2.9) 
44 (2.4) 
43 (2.5) 
37 (2.1) 
37 (2.0) 
36 (1.8) 
35 (1.3) 
35 (1.9) 
35 (2.0) 
33 (2.2) 
30 (1.9) 
28 (1.1) 
27 (2.5) 
24 (1.7) 
10 (1.6) 


Downloaded from http://pirls2016.org/download-center/ 


International Avg. 53 (0.3) 


® 
® 
® 
® 
® 
® 
® 
® 
® 
® 
® 
® 
® 
® 
® 


® 


° 
® 


bonen 


When does a sea turtle hold its breath for up to 5 hours? 


it sleeps. 


Benchmarking Participants 
Moscow City, Russian Fed. 
= Quebec, Canada 


Ontario, Canada 

2 Madrid, Spain 
Buenos Aires, Argentina 
Andalusia, Spain 
Abu Dhabi, UAE 
Eng/Afr/Zulu - RSA (5) 


Percent significantly higher than international average 


The answer shown illustrates the type of student response that would receive full credit (1 point). 


Percent 


Full Credit 


80 (1.7) 
60 (2.4) 
54 (2.4) 
50 (2.2) 
50 (2.0) 
40 (2.1) 
34 (2.0) 
32 (2.0) 
27 (2.3) 
17 (1.7) 


Percent significantly lower than international average 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


oo 
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Exhibit 2.5.9: High International Benchmark - Informational Example Item 3 


Purpose: Acquire and Use Information 
Process: Make Straightforward Inferences 


Description: Make a straightforward inference to provide 2 explanations 


Coun Percent 
Full Credit 

2 +t Hong Kong SAR 68 (2.4) 
Russian Federation 65 (1.9) 
Kazakhstan 64 (2.0) 
3 Singapore 58 (1.8) 
Finland 57 (1.9) 
Macao SAR 57 (2.0) 
Poland 56 (2.2) 
Chinese Taipei 54 (2.1) 
Czech Republic 53 (2.0) 
Sweden 52 (2.4) 
Australia 51 (1.9) 
Northern Ireland 51 (25) 
Slovak Republic 51 (2.0) 
2 Austria 50 (2.1) 
Norway (5) 50 (2.3) 
lreland 49 (2.1) 
Germany 49 (2.4) 
Bulgaria 49 (2.7) 
Hungary 48 (2.3) 
England 48 (1.9) 
New Zealand 48 (2.1) 
Lithuania 48 (2.5) 
Slovenia 45 (2.0) 
12 Canada 45 (1.7) 
t Netherlands 44 (2.5) 
3 Israel 44 (2.1) 
Italy 43 (2.1) 
2 Denmark 43 (2.3) 
France 42 (1.9) 
Spain 42 (1.6) 
t United States 42 (1.9) 
2 Latvia 36 (2.1) 
Chile 33 (1.8) 
Trinidad and Tobago 30 (2.0) 
2 Portugal 29 (1.9) 
2 Belgium (French) 28 (2.2) 
Belgium (Flemish) 26 (1.7) 
Azerbaijan 26 (2.2) 
Qatar 22 (1.6) 
' Georgia 20 (2.0) 
2 Malta 19 (1.6) 
Bahrain 19 (1.4) 
United Arab Emirates 18 (1.0) 
Iran, Islamic Rep. of 14 (1.4) 
Oman 13 (1.0) 
Saudi Arabia 11 (1.5) 
Morocco 7 (1.0) 


@ the 


What can confuse the hatchlings? 


ees 


coococoococoocoooooooocoocec]e 


®@D@D@D@ODDOODOHDHODOHODOHOO 


Moscow City, Russian Fed. 74 (1.8) 
2 Madrid, Spain 48 (2.3) 
= Quebec, Canada 45 (3.0) 
Andalusia, Spain 42 (2.6) 
Ontario, Canada 42 (3.1) 
Norway (4) 34 (2.2) 
Dubai, UAE 34 (1.2) 
Buenos Aires, Argentina 34 (2.2) 
Abu Dhabi, UAE 12 (1.7) 
Eng/Afr/Zulu - RSA (5) 11 (1.6) 


When the hatchling reaches the surface of the sand, 


what helps her go the right way? 


moonlhyht 


tg WTS 


Percent 


Full Credit 


Benchmarking Participants 


© Percent significantly higher than international average 
@ Percent significantly lower than international average 


co 


©@DOO@ 


The answer shown illustrates the type of student response that would receive full credit (2 points). 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.5.10: High International Benchmark - Informational Example Item 4 


Counby Percent 
Full Credit 

3 Singapore 74 (1.6) © 
Poland 68 (1.9) © 
England 68 (1.7) © 
Australia 67 (1.7) © 
Chinese Taipei 64 (1.7) O 

12 Canada 63 (18) © 

2 Latvia 61 (2.0) @ 

t United States 61 (24) @ 
Kazakhstan 59 (2.4) © 
Northern Ireland 59 (2.1) © 
Slovenia 57 (2.5) © 
Bulgaria 57 (23) © 
New Zealand 54 (2.0) © 
Ireland 54 (2.4) © 

2 +t Hong Kong SAR 54 (2.9) © 
Russian Federation §2 (1,7) © 
Norway (5) 51 (2.2) © 
Hungary 51 (2.4) 

2 Denmark 51 (23 
Lithuania SUS 
Slovak Republic 49 (2.1 

t Netherlands 49 (1.7 
Macao SAR 49 (2.3 
Finland 47 (2.0) 

4703) 
Trinidad and Tobago 46 (2.2 
Czech Republic 45 (2.1 
Italy 45 (2.4 

2 Belgium (French) 44 (1.9 

' Georgia 4A (2.6 
Germany 42 (2.5) @ 
Belgium (Flemish) 42 (2.4) @ 
Bahrain 41 (18) @ 
United Arab Emirates 41 (13) @ 

2 Portugal 41 (2.0) @ 

3 Israel 39 (2.0) @ 
Azerbaijan 39 (2.5) @ 

2 Austria 39 (23) @ 
Qatar 38 (1.2) @ 
France 35 (2.0) @ 
Chile 34 (2.2) @ 
Spain 34 (2.1) @ 
Oman 33 (1.8) @ 

2 Malta 31 (1.8) @ 
Sweden 30 (2.2) @ 
Saudi Arabia 28 (2.2) @ 
Morocco 13 (1.7) @ 
Iran, Islamic Rep. of 11 (14) @ 

° 
® 


Purpose: Acquire and Use Information 
Process: Evaluate and Critique Content and Textual Elements 


Grade 


Description: Evaluate the content of a diagram and interpret its meaning 


14. A diagram from the article is shown below. 


What does this diagram help you to understand? 


Hatchling 
Juveniles 


Laying Eggs 


the Pw TS 


ae Mk 


WW aAt 


of ahe Lfte cycle are 


The answer shown illustrates the type of student response that would receive full credit (1 point). 


Percent 
Country 


Full Credit 


Benchmarking Participants 


Moscow City, Russian Fed. 72 (1.7) © 
Ontario, Canada 64 (2.9) © 
Dubai, UAE 59 (1.4) © 
= Quebec, Canada 55 (3.3) O 
2 Madrid, Spain 41 (2.2) @ 
Norway (4) 35 (23) @ 
Andalusia, Spain 34 (2.0) @ 
Abu Dhabi, UAE 29 (1.9) @ 
Buenos Aires, Argentina 23 (1.8) @ 
Eng/Afr/Zulu - RSA (5) 18 (1.7) @ 


Percent significantly higher than international average 
Percent significantly lower than international average 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.6: Advanced International Benchmark (625) 


Exhibit 2.6 describes the reading comprehension skills and strategies demonstrated by fourth 
grade students at the Advanced International Benchmark. Students at the Advanced International 
Benchmark can take the entire text into account to provide full text-based support for their 
interpretations and explanations. They are able to evaluate the effect of the author's choices and 
visual elements. 

Exhibits 2.6.1 through 2.6.8 contain examples of the types of items successfully answered by 
students achieving at the Advanced International Benchmark, two based on the literary text “Flowers 
on the Roof? two based on the literary text “Macy,” and four based on the informational text “The 
Green Sea Turtle’s Journey” (see Appendix H). It can be seen that these items answered correctly 
by Advanced readers (50% or more of them) were very difficult for students internationally. Each 
exhibit shows achievement results for the countries that participated in PIRLS (and PIRLS Literacy 
for “Flowers on the Roof”), with up and down arrows indicating a significantly higher or lower 
percentage of success than the international average. The reading purpose, comprehension process, 
and scale anchoring description are provided above the item. For multiple-choice items, the correct 
response is indicated. Constructed response questions were worth 1, 2, or 3 points. Each constructed 
response item is shown with an illustrative student response and the amount of credit awarded the 
response is shown across the bottom of the exhibit, usually full credit. 

Example Items 2.6.1 and 2.6.2 are based on students integrating information across “Flowers 
on the Roof” to fully answer constructed response questions, first to interpret and explain how a 
character’s actions reflected her feelings and second to explain how feelings changed across the 
story. Example Item 2.6.3 asked students to integrate ideas across the “Macy” story to describe what 
she was like and give two examples, which was a challenge for the Advanced readers such that the 
item actually was a little too difficult to anchor and illustrates their boundaries. Example Item 2.6.4 
illustrates how students at the Advanced International Benchmark were able to evaluate text, in this 
case to explain why an alternative title would be better. 

Example Items 2.6.5, 2.6.6, and 2.6.7 (which just missed anchoring) illustrate that fourth grade 
readers at the Advanced International Benchmark can distinguish and integrate information across a 
relatively complex scientific text. In particular, the second two examples require students to interpret 
and integrate information to provide a full explanation. Example Item 2.6.8 asks students to evaluate 
the text about “The Green Sea Turtle’s Journey” from the writer's point of view. Indeed, the fourth 
grade students performing at the Advanced International Benchmark are accomplished readers. 
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Exhibit 2.6: Description of the PIRLS 2016 Advanced International Benchmark (625) 
of Reading Achievement 


Se Advanced International Benchmark 


6) 2 5 When reading relatively complex Literary Texts, students can: 


+ Interpret story events and character actions to describe reasons, motivations, feelings, and 
character development with full text-based support 


* Begin to evaluate the effect on the reader of the author's language and style choices 


When reading relatively complex Informational Texts, students can: 


* Distinguish and interpret complex information from different parts of text, and provide full text- 
based support 

+ Integrate information across a text to explain relationships and sequence activities 

* Begin to evaluate visual and textual elements to consider the author's point of view 


Z TIMSS & PIRLS 

International Study Center 
Zw l E Lynch School of Education 
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Exhibit 2.6.1: Advanced International Benchmark - Literary Example Item 1 


Country 


Norway (5) 
lreland 


Russian Federation 


2 Austria 


Northern Ireland 


Hungary 
Germany 
Italy 
2 Latvia 
Australia 
2 Denmark 


Slovak Republic 


Poland 

t Netherlands 

t United States 
New Zealand 
England 

2 Portugal 

2 Canada 
Sweden 
Spain 


2 Belgium (French) 


France 


Belgium (Flemish) 
Czech Republic 


Bulgaria 

1 Georgia 

3 Israel 
Lithuania 
Finland 


International Avg. cY-M(\)) 


Macao SAR 


Chinese Taipei 


Slovenia 

3 Singapore 
Chile 
Azerbaijan 


2 t Hong Kong SAR 


Kazakhstan 
2 Malta 


Iran, Islamic Rep. of 
Trinidad and Tobago 


Saudi Arabia 
Qatar 


United Arab Emirates 


Bahrain 
Oman 
Kuwait 
Morocco 
South Africa 


Egypt 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Downloaded from http://pirls2016.org/download-center/ 


Purpose: Literary Experience 
Process: Interpret and Integrate Ideas and Information 


Description: Integrate ideas across text to interpret the character's feelings about the 


When Granny Gunn was on the balcony, she crouched down so that 
she could not see any of the rooftops—only the mountains and the 
sky. Why did she do this? 


@ She could easily imagine hort 


the mountains 


were near her farm. 


Benchmarking Participants 
Moscow City, Russian Fed. 


2 Madrid, Spain 
Ontario, Canada 
Andalusia, Spain 

= Quebec, Canada 
Buenos Aires, Argentina 


©®D@D OH @D @ OOOO ODOOHHOH@M@HDOE 


Eng/Afr/Zulu - RSA (5) 
Abu Dhabi, UAE 


Percent significantly higher than international average 
Percent significantly lower than international average 


@ 


The answer shown illustrates the type of student response that would receive full credit (2 points). 


Percent 


Full Credit 


60 (2.2) 
48 (2.2) 
46 (2.4) 
Al (2.8) 
39 (1.9) 
37 (2.2) 
27 (2.3) 
27 (1.7) 
22 (1.4) 
10 (1.5) 

9 (1.3) 


were those that 


cocco 
SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


©@OO®@ 


TIMSS & PIRLS 
IEA International Study Center 


Lynch School of Education 
BOSTON COLLEGE 


Exhibit 2.6.2: Advanced International Benchmark - Literary Example Item 2 


Purpose: Literary Experience 
Process: Interpret and Integrate Ideas and Information 


Description: Interpret a change in the narrator’s feelings between the beginning and the 
end of the story 


Country 


Slovenia 
2 Latvia 
2 +t Hong Kong SAR 
Ireland 
Germany 
Bulgaria 
Sweden 
Russian Federation 

2 Austria 
Norway (5) 

2 Denmark 
Poland 
England 
Macao SAR 
Northern Ireland 

3 Israel 

2 Portugal 

3 Singapore 
Slovak Republic 
Hungary 

12 Canada 
Spain 

t United States 
Australia 
Chinese Taipei 
Italy 
Lithuania 


International Avg. 26 (0.3) 


Kazakhstan 
New Zealand 

t Netherlands 
Finland 

1 Georgia 

2 Malta 
France 
Czech Republic 
Belgium (Flemish) 
United Arab Emirates 
Bahrain 
Saudi Arabia 

2 Belgium (French) 
Qatar 
Trinidad and Tobago 
Chile 
Oman 
Kuwait 
Egypt 
Iran, Islamic Rep. of 
Azerbaijan 
Morocco 
South Africa 


What were the little boy’s feelings about Granny Gunn when she 
first moved in and at the end of the story? Use what you have read 
to describe each feeling and explain why his feelings changed. 


The \rttle boy Was disappoivtted Ipecause he 


way oping +noct kids would move in, bout his 
changed pecavS€ he Saw hecth 


She could do any Thing . 


Benchmarking Participants 
Moscow City, Russian Fed. 
2 Madrid, Spain 
Ontario, Canada 


Andalusia, Spain 
Buenos Aires, Argentina 


= Quebec, Canada 
Abu Dhabi, UAE 
Eng/Afr/Zulu - RSA (5) 


Percent significantly higher than international average 
Percent significantly lower than international average 
This item was designed to have a maximum of three points but was reduced to two points following item review. 


@®H@D DW @D @ OOO @OD@D@OGOW@OD OD OODOEO 


Percent 


Full Credit 


57 (2.3) 
41 (2.5) 
39 (2.8) 
29 (1.8) 
27 (1.9) 
24 (1.9) 
20 (1.7) 
19 (1.4) 
14 (1.7) 
12 (1.4) 

9 (1.7) 


oco 


©D@OO®@ 


The answer shown illustrates the type of student response that would receive full credit (2 points). 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.6.3: Advanced International Benchmark - Literary Example Item 3 


Purpose: Literary Experience 
Process: Interpret and Integrate Ideas and Information 


Description: Interpret ideas from across the text to identify a character trait and support it 
with 2 examples 


Country 


Hungary 
Poland 
3 Singapore 
2 t Hong Kong SAR 
England 
Australia 
Ireland 
Northern Ireland 
t United States 
2 Latvia 
Russian Federation 
12 Canada 
Spain 
3 Israel 
Chinese Taipei 
Norway (5) 
Bulgaria 
New Zealand 
Finland 
Italy 
Lithuania 


Sweden 
Germany 
Chile 
1 Georgia 
Slovak Republic 
t Netherlands 
Kazakhstan 
Czech Republic 
2 Portugal 
Trinidad and Tobago 
2 Denmark 
2 Austria 
United Arab Emirates 
Slovenia 
Macao SAR 
Bahrain 
2 Belgium (French) 
Qatar 
2 Malta 
Oman 
Belgium (Flemish) 
France 
Azerbaijan 
Saudi Arabia 
Iran, Islamic Rep. of 
Morocco 


Full Credit 


coooococoocoococeoocoeccoo 


International Avg. io (079) 


@D@D@DODOH@DODODOHOGDHDHDOHOHOHOO®O 


(4) 
® 


13. 


You learn what Macy is like from the things she does. 


Describe what Macy is like and give two examples from the story 


that show this. 


Macy is determined pecause ghe does viet 


ane up when the ced hen 6 


and she covitinues fo try different wos 


+o get -+he hen in the cage. 


Country 


Benchmarking Participants 
Moscow City, Russian Fed. 
2 Madrid, Spain 


Ontario, Canada 


= Quebec, Canada 


Andalusia, Spain 

Dubai, UAE 

Norway (4) 

Abu Dhabi, UAE 
Buenos Aires, Argentina 
Eng/Afr/Zulu - RSA (5) 


Percent 


Full Credit 


38 (1.7) 
31 (2.2) 
25 (2.7) 
21 (2.0) 
20 (1.9) 
14 (1.1) 
11 (1.3) 
5 (1.1) 
3 (0.9) 
1 (0.5) 


Percent significantly higher than international average 
Percent significantly lower than international average 


cooco 


©@@D@OEO 


The answer shown illustrates the type of student response that would receive full credit (3 points). 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Country 


Poland 
3 Singapore 
Ireland 
t United States 
Northern Ireland 
England 
Australia 
Russian Federation 
Lithuania 
12 Canada 
Bulgaria 
Finland 
2 Latvia 
Slovak Republic 
Kazakhstan 
Germany 
Hungary 
2 t Hong Kong SAR 
Slovenia 
Norway (5) 
Chinese Taipei 
2 Austria 
3 Israel 


International Avg. 34 (0.3) 


Italy 
t Netherlands 
2 Portugal 
New Zealand 
2 Belgium (French) 
Spain 
Sweden 
2 Denmark 
Trinidad and Tobago 
Czech Republic 
Bahrain 
Belgium (Flemish) 
Macao SAR 
Georgia 
United Arab Emirates 
Chile 
Azerbaijan 
Qatar 
France 
Oman 
Malta 
Iran, Islamic Rep. of 
Saudi Arabia 
Morocco 


N 


Full Credit 


ccoooocoocooceoocoococecco 


©@D DOD DODD DOOD OODHDOOOO 


@ 


3° 
® 


Give one reason. 


She did Find 


Description: Evaluate story events and character actions to explain why an alternative, 
given title would be appropriate 


Why would “Macy Finds a Way” be good as a different title for this 


the hen Ao 


Wanted . 


Benchmarking Participants 
Ontario, Canada 
Moscow City, Russian Fed. 


= Quebec, Canada 
Buenos Aires, Argentina 
2 Madrid, Spain 


Andalusia, Spain 
Abu Dhabi, UAE 
Eng/Afr/Zulu - RSA (5) 


Percent significantly higher than international average 


Percent 


Full Credit 


52 (3.0 
52 (2.1 
40 (1. 

Si (G5) 
31 (2.2 
28 (1.7 
26 (2.1 
25 (1.8 
14 (1.6 


) 
) 
2) 
) 
) 
) 
) 
) 
) 
14 (1.8) 


Percent significantly lower than international average 


coo 


©@©@D@OODEO 


The answer shown illustrates the type of student response that would receive full credit (1 point). 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 2.6.5: Advanced International Benchmark — Informational Example Item 1 


ee percent ff Process: Make Straightforwardinferences SOS 
Correct Description: Distinguish relevant information and make an inference about a scientific ms 
question s 
3 Singapore 67 (1.7) 3 
Russian Federation 61 (2.0) —s 5 
+ Netherlands 60 (2.4) 13. Which activity in an adult female green sea turtle’s life is not fully 2 
understood by scientists? = 
Sweden 59 (2.1) é 
Bulgaria 59 (2.6) @) how she can swim over 600 miles z 
— a how she makes a nest for her eggs 5 
2 Latvia 57 (1.9) © how she avoids being eaten by predators s 
Czech Republic 55 (2.0) ; g 
Chinese Taipei 55 (2.1) ® how she finds the right beach to lay her eggs 2 
Australia 55 (2.0) $ 
Hungary 55: (2.1) i} 
Lithuania 54 (2.2) 2 
Norway (5) 53 (2.2) 7 
Poland 53 (2.4) 
2 Denmark 52 (2.8) 
Ireland 52 (2.1) 
Germany 50 (2.3) 
Belgium (Flemish) 50 (2.0) 
England 50 (1.9) 
Italy 50 (2.3) 
t United States 49 (2.2) 
Northern Ireland 49 (2.4) 
Kazakhstan 49 (2.0) 
12 Canada 49 (1.6) 
2 Portugal 47 (2.3) 
2 Austria 47 (2.1) 
New Zealand 46 (2.0) 
3 Israel 46 (1.9) 
Slovenia 45 (2.3) 
#503) 
France 44 (2.1) 
2 +t Hong Kong SAR 43 (2.1) 
Chile 39 (19) @ perent 
' Georgia 38 (2.3) @ Country 
. Correct 
Spain 37 (1.6) @ 
Macao SAR 34 (2.0) @ 
United Arab Emirates 33 (13) © Benchmarking Participants 
2 Belgium (French) 32 (19) © Moscow City, RussianFed. 68 (18) 0 
Trinidad and Tobago 30 (2.1) @ Ontario, Canada 47 (2.5) 
Qatar 29 (13) @ = Quebec, Canada 47 (2.6) 
2 Malta 25 (1.7) @ Dubai, UAE 47 (1.7) 
Azerbaijan 25 (2.3) @ 2 Madrid, Spain 45 (2.1) 
Bahrain 24 (1.9) @ Norway (4) 43 (2.2) 
Oman 22 (14) @ Andalusia, Spain 37 (2.2) @ 
Saudi Arabia 19 (1.9) @ Buenos Aires, Argentina 31 (23) @ 
Iran, Islamic Rep. of 18 (2.0) @ Abu Dhabi, UAE 28 (2.2) @ 
Morocco 17 (16) @ Eng/Afr/Zulu - RSA (5) 22 (1.6) @ 
© Percent significantly higher than international average 


@ Percent significantly lower than international average 
See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Country 


Chinese Taipei 
Ireland 
Russian Federation 
t United States 
Northern Ireland 
England 
Sweden 
12 Canada 
New Zealand 
Australia 
Norway (5) 
2+ Hong Kong SAR 
Bulgaria 
Finland 
Kazakhstan 
Hungary 
t Netherlands 
Italy 
Germany 
2 Latvia 
2 Austria 
Macao SAR 
Slovak Republic 


International Avg. yy (\e)) 


Czech Republic 
Poland 
Lithuania 
Spain 
2 Denmark 
Slovenia 
2 Portugal 
France 
3 Israel 
Belgium (Flemish) 


Trinidad and Tobago 
United Arab Emirates 


Azerbaijan 
Qatar 
2 Belgium (French) 
1 Georgia 
Oman 
2 Malta 
Saudi Arabia 
Iran, Islamic Rep. of 
Bahrain 
Chile 
Morocco 
3 Singapore 


cooocooooooooococeo 


@®©DO@DD@A@D @O@OOGOHOHOOHOOO 


(4) 
® 


Exhibit 2.6.6: Advanced International Benchmark - Informational Example Item 2 


Purpose: Acquire and Use Information 
Process: Interpret and Integrate Ideas and Information 


Description: Distinguish and integrate information from across different sections to fully 
complete a table (5 of 5 entries) 


What information does the article provide about the sea turtle’s size 
and food at each stage of its life? 


Complete the table below. 


Three have been done for you. 


Stage of life 


egg 


The egg has its 


hatchling 


juvenile 


Country 


Benchmarking Participants 
Moscow City, Russian Fed. 


Ontario, Canada 
= Quebec, Canada 
2 Madrid, Spain 

Dubai, UAE 

Andalusia, Spain 

Norway (4) 


Buenos Aires, Argentina 


Abu Dhabi, UAE 


Eng/Afr/Zulu - RSA (5) 


Percent significantly higher than international average 


Percent 


Full Credit 


45 (1.8) 
36 (2.3) 
32 (2.7) 
32 (1.9) 
27 (1.5) 
21 (1.9) 
17 (1.5) 
12 (1.6) 
9 (1.5) 
4 (1.0) 


Percent significantly lower than international average 


coooco 


@©@@O® 


The answer shown illustrates the type of student response that would receive full credit (3 points). 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A dash (-) indicates comparable data not available. 
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Russian Federation 


Czech Republic 
2 +t Hong Kong SAR 


Slovak Republic 


Northern Ireland 


Chinese Taipei 


International Avg. 25 (0.3) 


t United States 


Belgium (Flemish) 
2 Belgium (French) 
Trinidad and Tobago 


United Arab Emirates 


Iran, Islamic Rep. of 


Downloaded from http://pirls2016.org/download-center/ 


° 
° 
° 
(4) 
(4) 
(4) 
(4) 
(A) 
° 
° 
° 
(4) 
(4) 
° 
(4) 
(4) 
° 
° 
° 


@ 


@®©@D @@O@GD OOO O@MWO@M@HDDOODE 


° 
® 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Exhibit 2.6.7: Advanced International Benchmark - Informational Example Item 3 


Purpose: Acquire and Use Information 
Process: Interpret and Integrate Ideas and Information 


Description: Integrate ideas to provide 2 explanations 


The color of a hatchling’s shell protects it from predators. 


Give a way it is protected from birds. 


AyT he dow eolor of “fhe fop part blends in 


with he wosrer when 


Give a way it is protected from sharks. 


A Tne wottorm ig vont. «SO Sharks 


Benchmarking Participants 
Moscow City, Russian Fed. 
Ontario, Canada 

2 Madrid, Spain 
= Quebec, Canada 
Andalusia, Spain 


Buenos Aires, Argentina 
Abu Dhabi, UAE 
Eng/Afr/Zulu - RSA (5) 


Percent significantly higher than international average 


may net Spot her in the sunlight 


The answer shown illustrates the type of student response that would receive full credit (2 points). 


Percent 


Full Credit 


54 (2.1) 
28 (2.5) 
28 (2.2) 
24 (2.2) 
21 (1.6) 
21 (1.9) 
20 (1.5) 
14 (1.7) 

7 (1.1) 

4 (1.0) 


Percent significantly lower than international average 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 
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t United States 


Russian Federation 


Northern Ireland 


2 +t Hong Kong SAR 


coococoooooooceoccoo 


Belgium (Flemish) 


Czech Republic 


International Avg. 49 (0.3 


Slovak Republic 
2 Belgium (French) 


Chinese Taipei 


United Arab Emirates 


Benchmarking Participants 
Moscow City, Russian Fed. 


= Quebec, Canada 
Ontario, Canada 


2 Madrid, Spain 
Andalusia, Spain 
Abu Dhabi, UAE 
Buenos Aires, Argentina 
Eng/Afr/Zulu - RSA (5) 


Trinidad and Tobago 


©@©@D@ OOD ODO @DODHH@DOHDDOODE 


Iran, Islamic Rep. of 


Exhibit 2.6.8: Advanced International Benchmark - Informational Example Item 4 


Purpose: Acquire and Use Information 
Process: Evaluate and Critique Content and Textual Elements 


Description: Evaluate textual elements and content to recognize how they exemplify the 
writer's point of view 


How does the writer show you that the green sea turtle is special? 
@) by asking you to help to save it 

e by telling you the amazing things it does 

© by describing how beautiful it looks 


© by warning you that few turtles are still alive today 


Percent 


Correct 


64 (2.2) 
55 (1.7) 
51 (2.8) 
49 (3.2) 
43 (2.1) 
40 (2.3) 
36 (2.0) 
34 (2.0) 
33 (2.0) 
28 (2.1) 


Percent significantly higher than international average 


Percent significantly lower than international average 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A dash (-) indicates comparable data not available. 
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See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 
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GOARIER 5: 
AGHIEVEMEN TiN 
AVP IN LE MU Cn Od) SS) 
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PROGESSES 


PIRLS ZU10 INTERNATIONAL RESULTS 
IN REAUING 


Z TIMSS & PIRLS 
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READING-FOURTH GRADE PIRLS 
PAV 


Achievement by Reading Purposes 


PIRLS provided results at the fourth grade for two reading purposes — Literary and 
Informational. Most countries demonstrated a relative strength in one of the purposes, 
often accompanied by a relative weakness in the other purpose. 


Pees 2016: 50 Countries Trends 2011-2016: 
Literary O 41 Countries 


Literary 


19 
Relative Weakness 


Informational 

O 7 
Informational 
17 


Relative Weakness 


tC) 
Number of Countries Where Girls Outperformed 


Boys in Reading Purposes Trends 2001-2016: 
20 Countries 


Literary 
8 


12 similar 


2 SVfealitele 1 


Informational 
12 


Literary Informational 


Achievement by Comprehension Processes 


PIRLS provided results at the fourth grade for two comprehension processes — 

Retrieving/Straightforward Inferencing and Interpreting/Integrating/Evaluating. Most 

countries demonstrated a relative strength in one of the processes, often accompanied 

by a relative weakness in the other process. 

PIRLS 2016: 50 Countries hasta estado 
41 Countries 


Retrieving and Inferencing 


Retrieving and 
Straightforward 
Inferencing 


18 


Relative Weakness 


Interpreting and Integrating 
8 
Interpreting, 


Integrating, 
and Evaluating 


18 


Relative Weakness 
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CHAPTER 3 


Achievement in Reading Purposes and 
Comprehension Processes 


Exhibit 3.1: Achievement in Reading Purposes 


The PIRLS 2016 Assessment Framework focuses on two overarching purposes for reading that 
account for most of the reading done by young students both in and out of school: for literary 
experience, and to acquire and use information. 

In literary reading, readers engage with the text to become involved in events, settings, actions, 
consequences, characters, atmosphere, feeling, and ideas as well as to enjoy language itself. The PIRLS 
and PIRLS Literacy assessments use narrative fiction as the main form of literary texts because it 
works well in an international context. For example, given the differences in languages and curricula 
across the participating countries, it is difficult for PIRLS to include poetry because it is difficult to 
translate and plays are not widely taught in the primary grades. 

Informational texts are both written and read for a wide variety of functions. While the primary 
function of informational text is to provide information, writers often address the subject matter with 
different objectives and perspectives. Many informational texts are straightforward presentations of 
facts, but they also can be subjective such as an argument or expository essay. Informational texts 
often contain information presented via lists, charts, graphs, and diagrams. In addition, words need 
not be in the form of continuous text and may be in sidebars, timelines, text boxes, or other various 
forms of depicting information. 

Exhibit 3.1 presents the fourth grade reading achievement results for the two reading purposes 
assessed by PIRLS 2016—literary and informational. To examine relative performance in the 
purposes, PIRLS used item response theory (IRT) scaling to place achievement in the two purposes 
on the PIRLS 2016 achievement scale. Exhibit 3.1 provides the overall average PIRLS achievement 
score from Exhibit 1.1, as well as the average scale score for each purpose together with the difference 
between reading achievement overall and achievement in the purpose. Up and down arrows are 
used to indicate whether a country’s average score in a purpose is significantly higher or lower 
than its overall PIRLS average score. Generally, the higher performing countries overall had higher 
achievement in the purposes and the lower performing countries had lower achievement. However, 
most countries demonstrated a relative strength in one of the purposes, often accompanied by a 
relative weakness in the other purpose. Sixteen countries performed higher in literary reading than 
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on PIRLS overall, and 11 countries performed lower than they did overall. Similarly, 16 countries had 


higher achievement in informational reading than on PIRLS overall, while 15 countries had lower 
results. Often (in 23 countries) a strength in literary reading was accompanied by a weakness in 
informational reading or vice versa, but not always. Some countries had only a strength or weakness 
in one purpose for reading or the other. 
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Exhibit 3.1: Achievement in Reading Purposes 


ee ; Difference Purpose Score Purpose Score 
werage from Overall Lower than Overall Higher than Overall 


Overall 


Countr bags 
u Average Scale 


Score 


Average 


from Overall 
Scale Score Scale Score 


PIRLS Score PIRLS Score PIRLS Score PIRLS Score 


© 
a 
. 
2 
g 
Russian Federation 581 (2.2) 579 (2.2) 2 (1.1 584 (2.3) 4 (1.0) (4) a g 
3 Singapore 576 (3.2) 575 (3.3) -2 (13 579 (3.3) 2 (1.1) (4) Lal 2 
2 t Hong Kong SAR 569 (2.7) 562 (3.0) -6 (13 ® 576 (2.8) 8 (1.1) 4) a a 
Ireland 567 (2.5) 571 (2.7) 5 (14) (4) 565 (2.7) -2 (1.1) a g 
Finland 566 (1.8) 565 (1.9) -1 (1.0 569 (2.0) 3 (0.7) (4) L 8 
Poland 565 (2.1) 567 (2.2) 2 (13 564 (2.6) 0 (1.5) = g 
Northern Ireland 565 (2.2) 570 (2.5) 6 (1.4) (4) 561 (2.3) -4 (14) ®@ | el a 
Norway (5) 559 (2.3) 560 (2.5) 1 (1.5) 559 (2.4) 0 (1.0) : 5 
Chinese Taipei 559 (2.0) 548 (2.0) -11 (1.2 ® 569 (2.2) 10 (1.5) (4) —__ o 
England 559 (1.9) 563 (2.2) 4 (14) (4) 556 (2.1) -2 (0.9) ®@ = re 
2 Latvia 558 (1.7) 555 (1.9) -3(15 561 (1.8) 4 (0.9) 4) co u 
Sweden 555 (2.4) 556 (2.4) 1 (0.8 555 (2.6) 0 (1.3) LJ 8 
Hungary 554 (2.9) 558 (2.8) 3 (1.0 (4) 551 (3.3) -4 (1.6) ® 
Bulgaria 552 (4.2) 551 (4.5) 0 (1.1 554 (4.2) 2 (1.0) A) 
t United States 549 (3.1) 557 (3.0) 8 (1.4) (4) 543 (3.1) -6 (1.1) ®@ a 
Lithuania 548 (2.6) 547 (2.7) -1 (1.6) 551 (2.6) 2 (1.5) L 
Italy 548 (2.2) 549 (2.1) 1 (18 549 (2.2) 1 (0.9) ' 
2 Denmark 547 (2.1) 551 (2.2) 4(15 (4) 543 (2.5) -4 (1.3) ®@ a 
Macao SAR 546 (1.0) 536 (1.7) -10 (1.7 ® 556 (1.3) 10 (1.1) (4) as 
t Netherlands 545 (1.7) 546 (1.7) 1 (1.0 545 (1.9) 0 (1.1) . 
Australia 544 (2.5) 547 (2.4) 3 (13 (4) 543 (2.6) -2 (1.0) —_ 
Czech Republic 543 (2.1) 545 (2.1) 2 (1.0) 541 (2.3) -2 (14) = 
12 Canada 543 (1.8) 547 (1.9) 4 (08 (4) 540 (1.9) -3 (0.8) ®@ = 
Slovenia 542 (2.0) 541 (2.4) -1 (13 544 (2.1) 2 (0.8) (4) . 
2 Austria 541 (2.4) 544 (2.3) 4(1.1 (4) 539 (2.4) -2 (0.9) ® — 
Germany 537 (3.2) 542 (3.3) 5 (1.0 (4) 533 (3.3) -4 (1.2) @ = 
Kazakhstan 536 (2.5) 527 (2.5) -9 (1.2 ® 544 (2.8) 8 (1.5) 4) as 
Slovak Republic 535 (3.1) 539 (3.0) 4 (1.2) (4) 531 (3.1) -4 (1.3) @ —= 
3 Israel 530 (2.5) 532 (2.6) 2(1.1 529 (2.5) -2 (1.0) = 
2 Portugal 528 (2.3) 528 (2.5) 0 (1.2) 528 (2.3) 1 (0.8) 
Spain 528 (1.7) 530 (1.9) 2 (0.7 (4) 527 (1.6) -1 (0.6) m= 
Belgium (Flemish) 525 (1.9) 524 (1.9) -1 (1.1) 526 (1.9) 1 (0.8) L 
New Zealand 523 (2.2) 525 (2.3) 3 (1.1 (4) 520 (2.4) -2 (0.9) ® 
France 511 (2.2) 513 (2.4) 1 (0.9) 510 (2.4) -1 (0.8) w 
2 Belgium (French) 497 (2.6) 504 (2.2) 6 (1.2 (4) 490 (2.4) -7 (1.2) @ Le 
Chile 494 (2.5) 500 (2.5) 7 (1.2 (4) 485 (2.7) -9 (1.1) ® nae 
' Georgia 488 (2.8) 490 (2.6) 2(1.1 486 (3.1) -2 (1.0) ® = 
Trinidad and Tobago 479 (3.3) 478 (3.3) -1 (0.9) 480 (3.5) 1 (1.1) Z 
Azerbaijan 472 (4.2) 466 (3.9) -6 (1.3 ® 477 (4.6) 5 (13) ° — 
2 Malta 452 (1.8) 452 (2.0) 0 (1.3) 451 (2.0) -1 (1.5) 
United Arab Emirates 450 (3.2) 440 (3.4) -10 (0.7 ® 460 (3.2) 10 (0.6) (4) ae 
Bahrain 446 (2.3) 437 (2.8) -9 (1.1 ® 453 (2.1) 7 (1.1) 4) a 
Qatar 442 (1.8) 434 (2.3) -8 (1.0 ® 450 (1.9) 7 (1.0) (4) — 
Saudi Arabia 430 (4.2) 430 (4.0) 0 (1.1 429 (4.5) -1 (1.5) 
Iran, Islamic Rep. of 428 (4.0) 430 (3.8) 2 (13 425 (3.8) -3 (1.2) ® _ 
Oman 418 (3.3) 411 (3.3) -8 (0.9 ® 425 (3.3) 7 (0.8) (4) — 
Kuwait 393 (4.1) 388 (4.3) -6 (1.2 ® 398 (4.3) 5 (1.5) ° — 
Morocco 358 (3.9) 353 (4.0) -5 (0.9) ® 359 (4.0) 1 (1.3) — 
Egypt 330 (5.6) 328 (5.5) -2 (1.2 332 (5.8) 1 (0.9) = 
South Africa 320 (4.4) 323 (4.7) 3 (14) (4) 314 (4.5) -6 (1.0) ®@ _ 
5 a : 7 e 
Scale score significantly higher than overall PIRLS score © ™@ Literary Reading 
Scale score significantly lower than overall PIRLS score @ Informational Reading 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 3.1: Achievement in Reading Purposes (Continued) 


Difference 
from Overall 
PIRLS Score 


Overall 


PIRLS 
Country Difference 
from Overall 


PIRLS Score 


Average Scale 
Score 


Average 
Scale Score 


Benchmarking Participants 


Moscow City, Russian Fed. 612 (2.2) 613 (2.2) 1 (1.2) 

2 Madrid, Spain 549 (2.0) 551 (2.2) 1(13} 

= Quebec, Canada 547 (2.8) 550 (2.9) 2 (1.6) 
Ontario, Canada 544 (3.2) 549 (3.2) 5(14) Oo 
Andalusia, Spain 525 (2.1) 526 (2.1) 1 (1.1) 
Norway (4) 517 (2.0) 520 (2.1) 4 (0.8) (4) 
Dubai, UAE 515 (1.9) 508 (2.1) -7 (1.2) ®@ 

2 Denmark (3) 501 (2.7) 505 (2.5) 4 (2.0) (4) 
Buenos Aires, Argentina 480 (3.1) 484 (3.1) 4 (1.0) (4) 
Abu Dhabi, UAE 414 (4.7) 406 (4.8) -9 (1.4) ® 
Eng/Afr/Zulu - RSA (5) 406 (6.0) 402 (6.3) -4 (1.2) ®@ 


Scale score significantly higher than overall PIRLS score © 
Scale score significantly lower than overall PIRLS score @ 
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Average 


Scale Score 


613 (2.5) 
549 (2.0) 
547 (3.0) 
539 (3.4) 
524 (2.2) 
514 (2.2) 
523 (2.1) 
498 (2.4) 
475 (3.3) 
422 (5.0) 
407 (6.0) 


1 (1.4) 
0 (0.9) 
-1 (1.0) 
-4 (1.5) 
-1 (0.8) 
=3 (1.1) 
8 (1.0) 
-3 (2.4) 
-5 (1.7) 
8 (1.6) 
1 (1.2) 


Lower than Overall 


Higher than Overall 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 3.2: Achievement in Comprehension Processes 


The PIRLS 2016 Assessment Framework integrates four broad-based comprehension processes within 


each of the two purposes for reading: focus on and retrieve explicitly stated information, make 
straightforward inferences, interpret and integrate ideas and information, and evaluate and critique 
content and textual elements. To summarize fourth grade achievement across countries for the 
comprehension processes, Exhibit 3.2 presents results for two scales—each encompassing two of 
the four processes. The Retrieving and Straightforward Inferencing scale includes items assessing 
the retrieval process (20% of the assessment) and those assessing straightforward inferencing (30%). 
The Interpreting, Integrating, and Evaluating scale combines the interpreting and integrating process 
items (30%) with the evaluating and critiquing content items (20%). 

To examine relative performance on the two process scales, PIRLS used item response theory 
(IRT) scaling to place achievement in each of the two processes on the PIRLS 2016 achievement 
scale. Exhibit 3.2 shows the overall average PIRLS achievement as well as the average scale score 
for each process with the difference between reading achievement overall and achievement in the 
process. Up and down arrows are used to indicate whether a country’s average score for a process is 
significantly higher or lower than its overall PIRLS average score. Generally, the higher performing 
countries overall had higher achievement in the reading comprehension processes and the lower 
performing countries had lower achievement. Nevertheless, most countries had a relative strength 
in one process or the other. The results within countries indicate that fourth grade students in the 
same number of countries had a relative strength in retrieving/straightforward inferencing as they 
did in interpreting/integrating/evaluating. Interestingly, fourth graders in fewer countries had a 
relative weakness in retrieving/straightforward inferencing compared with the number of countries 
with a relative weakness in interpreting/integrating/evaluating. Across the countries, the results show 
that 14 countries performed higher on the Retrieving and Straightforward Inferencing scale than 
on PIRLS overall, and 13 countries had lower achievement on that scale than they did overall. In 
comparison, 14 countries had higher achievement on the Interpreting, Integrating, and Evaluating 
scale than on PIRLS overall, while 18 countries had lower results. 
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Exhibit 3.2: Achievement in Comprehension Processes 


Retrieving and Interpreting, Integrating, 
Straightforward Inferencing and Evaluating 


Difference 


Overall 


PIRLS 
Average Scale 
Score 


Country 
Difference Difference Process Score Process Score 


A r) 
babies eke from Overall Lower than Overall Higher than Overall 


from Overall 
Scale Score Scale Score 


PIRLS Score PIRLS Score PIRLS Score PIRLS Score 


z 
3 
Russian Federation 581 (2.2) 581 (2.3) 1 (0.9) 582 (2.2) 1 (1.5) L] £ 
3 Singapore 576 (3.2) 573 (3.1) 3(10) © 579 (3.2) 3 (0.7) 0 = 3 
2 +t Hong Kong SAR 569 (2.7) 568 (2.7) -1 (1.1) 568 (2.9) 0 (0.9) L g 
Ireland 567 (2.5) 566 (2.6) -1 (1.1) 569 (2.9) 3 (1.4) . 8 
Finland 566 (1.8) 572 (2.0) 6 (0.9) 562 (1.8) 4(0.7) @ ad 2 
Poland 565 (2.1) 560 (2.1) (1.1) © 570 (2.4) 5(1.7) 0 — £ 
Northern Ireland 565 (2.2) 562 (2.1) 3(11) © 567 (2.2) 3 (1.4) oon 4 
Norway (5) 559 (2.3) 561 (2.4) 3 (1.5) 558 (2.4) -1 (1.2) = & 
Chinese Taipei 559 (2.0) 560 (1.9) 1 (0.9) 558 (2.2) -1 (1.3) LT] a 
England 559 (1.9) 556 (2.0) 3(0.7) @ 561 (1.9) 3 (0.7) Oo ca 8 
2 Latvia 558 (1.7) 554 (1.9) -4(1.0) © 562 (1.7) 4(09) oO c—— 3 
Sweden 555 (2.4) 560 (2.7) 5(1.0) oO 553 (2.5) 2 (08) © — 
Hungary 554 (2.9) 552 (3.3) -3 (1.5) 557 (3.0) 3(1.1) 0 Lael 
Bulgaria 552 (4.2) 550 (4.0) -1 (1.0) 552 (4.3) 1 (1.0) Ls 
t United States 549 (3.1) 543 (3.0) -7 (08) @ 555 (3.1) 6(07) Oo i 
Lithuania 548 (2.6) 549 (2.6) 1 (1.3) 548 (2.6) 0 (1.5) . 
Italy 548 (2.2) 547 (2.1) -1 (1.1) 550 (2.1) 2 (1.3) L 
2 Denmark 547 (2.1) 550 (2.1) 2(1.1) oO 546 (2.2) -1 (1.4) a 
Macao SAR 546 (1.0) 549 (1.1) 4(11) O 543 (1.6) 3(1.0) @ — 
t Netherlands 545 (1.7) 546 (2.0) 2 (1.0) 544 (1.7) 0 (0.9) = 
Australia 544 (2.5) 541 (2.6) -4(14) © 549 (2.4) 5(1.0) Oo —_ 
Czech Republic 543 (2.1) 551 (2.4) 8(10) oO 538 (2.2) -5 (1.2) © a 
12 Canada 543 (1.8) 541 (1.8) -2 (06) @ 545 (1.8) 2(0.7) Oo = 
Slovenia 542 (2.0) 547 (2.3) 4(09) oO 539 (2.5) 3(12) © — 
2 Austria 541 (2.4) 550 (2.8) 9(14) 0 534 (2.5) -6 (1.0) @ a 
Germany 537 (3.2) 546 (3.3) 8 (0.9) Oo 530 (3.2) 7(10) @ —— 
Kazakhstan 536 (2.5) 529 (2.5) -7 (08) @ 542 (2.4) 6(0.9) Oo a 
Slovak Republic 535 (3.1) 538 (3.1) 3 (1.2) 0 531 (3.2) 3(12) © em 
3 Israel 530 (2.5) 530 (2.4) -1 (1.0) 530 (2.7) 0 (1.0) . 
2 Portugal 528 (2.3) 528 (2.2) 0 (0.8) 526 (2.4) -1 (0.9) 
Spain 528 (1.7) 526 (1.7) -1(0.6) @ 529 (1.7) 1006) O 7 
Belgium (Flemish) 525 (1.9) 526 (2.1) 1 (1.3) 524 (2.2) -1 (1.2) Z 
New Zealand 523 (2.2) 521 (2.3) -1 (1.0) 525 (2.4) 2(08) © a 
France 511 (2.2) 521 (2.3) 9(09) Oo 501 (2.4) -10 (0.7) @ a 
2 Belgium (French) 497 (2.6) 501 (2.3) 3(13) 0 494 (2.4) 3(14) @ —_ 
Chile 494 (2.5) 496 (2.5) 2 (1.1) 491 (2.9) 3 (1.0) © = 
1 Georgia 488 (2.8) 486 (2.6) 2(11) © 490 (2.9) 2 (0.9) = 
Trinidad and Tobago 479 (3.3) 483 (3.6) 4(15) 0 472 (3.6) 7 (1.0) © — 
Azerbaijan 472 (4.2) 477 (4.2) 5(10) oO 465 (4.3) 8 (0.9) @ — 
2 Malta 452 (1.8) 452 (1.7) 0 (1.2) 451 (1.9) -1 (1.5) 
United Arab Emirates 450 (3.2) 448 (3.2) 2(1.0) @ 453 (3.3) 2(08) © = 
Bahrain 446 (2.3) 444 (2.1) -2 (0.9) 446 (2.7) 0 (1.5) = 
Qatar 442 (1.8) 442 (1.8) 0 (0.7) 441 (1.9) -1 (0.8) 
Saudi Arabia 430 (4.2) 425 (4.1) 5 (17) @© 439 (4.1) 8 (15) —_= 
Iran, Islamic Rep. of 428 (4.0) 429 (4.0) 2 (1.4) 425 (4.1) 3(13) @ a 
Oman 418 (3.3) 419 (3.2) 1 (1.1) 415 (3.6) -4(0.9) © 
Kuwait 393 (4.1) 394 (4.1) 0 (1.2) 388 (4.5) -5 (12) © 
Morocco 358 (3.9) 364 (3.9) 6(0.9) Oo 336 (4.5) 22(14) @¢ —_ 
Egypt 330 (5.6) 329 (5.6) -1 (1.4) 340 (5.7) 9(2.1) oO / 
South Africa 320 (4.4) 321 (4.5) 2 (0.9) 308 (5.3) -11(1.9) © = 


Scale score significantly higher than overall PIRLS score © 
Scale score significantly lower than overall PIRLS score @ @! Retrieving and Straightforward Inferencing 
Interpreting, Integrating, and Evaluating 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 3.2: Achievement in Comprehension Processes (Continued) 


Retrieving and 


Medak Straightforward Inferencing 


PIRLS 
Average Scale 


Country 


Difference 
from Overall 
PIRLS Score 


Average 
Scale Score 


Benchmarking Participants 


Moscow City, Russian Fed. 612 (2.2) 611 (2.4) -1 (1.1) 

2 Madrid, Spain 549 (2.0) 547 (2.0) 2(1.0) @ 

= Quebec, Canada 547 (2.8) 551 (3.0) 4(14) O 
Ontario, Canada 544 (3.2) 539 (3.3) -5 (1.4) ® 
Andalusia, Spain 525 (2.1) 522 (1.9) -3(08) @ 
Norway (4) 517 (2.0) 521 (2.0) 5(1.0) © 
Dubai, UAE 515 (1.9) 512 (2.4) 3(15) @ 

2 Denmark (3) 501 (2.7) 500 (2.3) -1 (2.1) 
Buenos Aires, Argentina 480 (3.1) 483 (2.9) 3 (1.0) (4) 
Abu Dhabi, UAE 414 (4.7) 413 (4.6) -1 (1.8) 
Eng/Afr/Zulu - RSA (5) 406 (6.0) 407 (6.1) 1 (1.4) 


Scale score significantly higher than overall PIRLS score © 
Scale score significantly lower than overall PIRLS score @ 
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Interpreting, Integrating, 
and Evaluating 


Average 


Scale Score 


614 (2.1) 
550 (2.0) 
545 (3.0) 
548 (3.2) 
527 (2.3) 
513 (1.9) 
519 (1.9) 
504 (2.5) 
473 (3.7) 
417 (4.7) 
400 (6.2) 


Difference 
from Overall 
PIRLS Score 


2 (1.0) 
1 (1.0) 
-2 (1.3) 
5 (1.0) 
2 (1.6) 
-4 (1.3) 
4 (1.2) 
3 (1.9) 
-7 (1.4) 
2 (1.4) 
-6 (1.6) 


Lower than Overall 


Higher than Overall 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 3.3 and 3.4: Trends in the Reading Purposes 
Differences in average reading achievement in the literary and informational purposes are presented 
for the countries that have comparable data from one or more of the previous assessments in 
2001, 2006, and 2011. Exhibit 3.3 depicts the results graphically for the countries in alphabetical 
order, while Exhibit 3.4 provides the detailed results from assessment to assessment. Mirroring the 
overall results, the trends in reading achievement in both purposes are more up than down. Twenty 
countries have data for the 15 year period between 2001 and 2016, with 8 showing increases in 
literary reading and only 1 a decrease. Similarly, 12 showed increases in informational reading and 
only 2 had decreases. Interestingly, while 13 countries had the same pattern for both purposes (both 
increasing, staying the about the same, or decreasing), the other 7 countries had different results for 
one purpose than for the other. 

Forty-one of the countries participated in both 2011 and 2016, with 19 showing improvements 
in literary reading and 7 showing decreases. Compared to five years earlier, 17 countries had higher 
achievement in 2016 in informational reading and 9 had lower achievement. The trends within 
countries were not necessarily the same for literary and informational reading. 
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Exhibit 3.3: Trends in Achievement by Reading Purpose 


Ko) 
: @ ; = eae Pare , © 
Scale interval is 10 points for each country, but the part of the scale shown differs Hea newt sales eae ue R 
according to each country's average achievement. E]D nef Txst te ny (Mylo z 
if 
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Exhibit 3.3: Trends in Achievement by Reading Purpose (Continued) 
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Exhibit 3.3: Trends in Achievement by Reading Purpose (Continued) 
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Exhibit 3.3: Trends in Achievement by Reading Purpose (Continued) 
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Exhibit 3.3: Trends in Achievement by Reading Purpose (Continued) 
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than other reading purpose 


Ko) 
R 
z 
T 
= 
2001 2006 2011 2016 2001 2006 2011 2016 2001 2006 2011 2016 3 
+ = + 5 
560 360 560 2 
nel 
544* 4 
5 
530* & 
325 = 323 * 2 
og 517* 516%. 577 s 
1)" s 
314 2 
507 = 
: 
3 
480 280 480 a 
Sweden ANd talcet-XeW-Tate iio) oy-\e Le) United Arab Emirates 
2001 2006 2011 2016 2001 2006 2011 2016 2001 2006 2011 2016 
+ a T 
590 500 480 
480 460* 
* 
474 457* 
478 
467 
a 
4369 427 
433 
510 420 400 


ni 
fF 
h 


2001 2006 2011 2016 
590 
563* 
510 


e TIMSS & PIRLS 
F IEA International Study Center 123 


KK Lynch School of Education 
Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


WAU ip crade 


Exhibit 3.3: Trends in Achievement by Reading Purpose (Continued) 
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Exhibit 3.4: Differences in Achievement for Reading Purposes 
Across Assessment Years 


Instructions: Read across the row to determine if the performance in the row year is significantly higher (Q) or 
significantly lower (®) than the performance in the column year. 


Country Average Differences Between Years Average Differences Between Years 
Australia 


2016 | 70) | uO) | || eH) | uO] | 
2011 | 527 04) [| | 52803) (I 


Austria 
| 54423) | 120 | 5s | 


2016 


sa) | Bol 3 |) 


2011 | 53322) | @ | HAT P| | 
200s | 022 | | || 3603) | 
Azerbaijan 


201s. | edt) | 3 |SSCSdYStC(“‘Cé*wrL OSA): CSO TUCd 

2011 | 4618) [oo oo) | i | 00) (oo) 
Belgium (Flemish) 

2016 | sais) | | z®] || 09 | | 23®] | 

2006_| 619) | [|| 3900 | 


Belgium (French) 


2016 | svi) | 6%) | || ois) | s@) | 
2011_| 07) [oo | 8 
Chinese Taipei 
“5800 | 70] wOl | 
mis) [98 


539 (1.9 


543 (2.5 


) 


aa 
Finland 
2016 [| 3509) | 4 [oc] | 5900 | 1 |iilln/ulnnnn 
2011 [568 (1.9) |e) [568 (1.5) 
France 


© More recent year significantly higher 


@ More recent year significantly lower 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Trend results for Azerbaijan do not include students taught in Russian. Trend results for Lithuania do not include students taught in Polish or in Russian. 
See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 3.4: Differences in Achievement for Reading Purposes 
Across Assessment Years (Continued) 


Instructions: Read across the row to determine if the performance in the row year is significantly higher (Q) or 5 
significantly lower (®) than the performance in the column year. a 
: 
1 
Country Average Differences Between Years Average Differences Between Years . 
So ot [ef 20 se P| 
Georgia 2 
486 (3.1) | 4O | jg 
482 (3.2) ee 
46268) ee: 
<4 
uv 
3 533 (3:3) a ae 
5 538 (2.5) 4 
546 (2.4) g 
539 (1.9) = 
re 
562 (3.0) 576 (2.8) fs 
565(25) [55 O | 578 (2.2) 2 
559(26) | 89D | 570 (2-4) as 2 
520 (3.5) | L_ 5378.1) as 
558(28) | 6O | 1 | 6 |) 55133) | 8 
542 (28) | 7 © | 10 © || 536 3.0) =| 
5593.0) [8 Oo 5423.1) er 
551 (2.2) | L_ 537 23) a 
Iran, Islamic Rep. of 
2016 430(38) | 29% | 6 425 (3.8) | to 
459 (29) | 34 8 455 (3.0) 4 0 
425 (33) 415 (3.2) | 
420(45) | 403 (4.7) — 
Ireland 
2016 S727) | 14 565 (2.7) | 16. © PT 
2011 557 7) | 549 (23) 
Israel 


2016 | 53226 | 9 @ | {59 25) | @ 
2011 | 542(2.8) L541.) 


Italy 
| 549(2.2) [4 fT 2 8 
| 545(2.0) [Ts 8 8 
 fitok 


|__527 (2.1) | 
5300.7) 
53928) 


2016_ | 45220) | 6 @ [| seo) | 
2011 | 4580.7) L455 2.0 


Morocco 
2016 | 353(40) | 54 [7 | 35940) | 38 OS 
2011 | 2993.7) a L321.) 


© More recent year significantly higher 


@ More recent year significantly lower 


)K Reservations about reliability of average achievement because the percentage of students with achievement too low for estimation exceeds 25%. 
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Exhibit 3.4: Differences in Achievement for Reading Purposes 
Across Assessment Years (Continued) 


Instructions: Read across the row to determine if the performance in the row year is significantly higher (Q) or 
significantly lower (®) than the performance in the column year. 


Country Average Differences Between Years Average Differences Between Years 
Netherlands 


3 
| 545 (2.4) | 


9 © 
| 526 (4.0) [| 
Northern Ireland 


2016 | 570(25) | 7 5623) | 
2011_| 564 (2.7) i |__555 (25) 


Norway (4) 


=) 


2016 | 4113.3) | 31 © P8583) | 22 © PT 
2011_ | 379 (28) ee | 404 (3.0) |i 
Portugal 
2016 | 528 (25) | -10 © =| 528 23) | 15 @ = 
2011_ | 538 (2.7) ey | 544 (2.7) | 
Qatar 
2016 | 434023) | 19 © [Tso 4 © 
2011 | 4153.8) [a  L_436.85) 


Russian Federation 


03) | 5O| wO| 40 


| 530(4.6) | 
Saudi Arabia 
2016 | 430 (40) | 8 ag tas) | 
2011 | 422 (4.7) 440045) 
Singapore 
| 575133) | 8 | oO | 4 O |] 57983) | 90 | uO | 10 | 
| 56735) 30 | 30 |] 56932) Te 4 | 420 | 


| 5546.1) SS 238 | 
| 5316.6) | 


[se 
|_ 2 | 
| 9 © 

9) 
= 


527 (2.9 
522 (3.0) 


) 


523 (2.4) 
502 (2.1 


© More recent year significantly higher 


@ More recent year significantly lower 


SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 


W Reservations about reliability of average achievement because the percentage of students with achievement too low for estimation does not exceed 25% but exceeds 15%. 
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Exhibit 3.4: Differences in Achievement for Reading Purposes 
Across Assessment Years (Continued) 


Instructions: Read across the row to determine if the performance in the row year is significantly higher (Q) or 
significantly lower (®) than the performance in the column year. 


Country Average Differences Between Years Average Differences Between Years 
Scale Score 2011 2006 | 2001 | Scale Score 20 2006 2001 
South Africa 


2016 | 32347) [2 TT [34 as) 6 
2011 | 325 (4.5) 319042) 
Spain 
2016 {| 53019) [4 [3 FT saz) TsO | 19 © 
2 | 512(2.2) | 
| 507 (28) | 


United Arab Emirates 


2016 | 404 | 13 | fa.) 
2011 | 427 (2.3) I L452. 2.2)_ 


United States 


Benchmarking Participants 


Ontario, Canada 
"55826 [| 


5588.2) 
| 5543.4) 


Eng/Afr/Zulu - RSA (5) 


2016 | 40263) | |r) | 
2006 | 34288) | | 88783) | 


Andalusia, Spain 


2016 | 52621) | 8 O |e) | oO Pf 

2011 | 518 (24) [L522 23) 
Abu Dhabi, UAE 

2016 | 406448) | 8 | | ||) | 5 | F 

2011_| 414 (49) ey | 437 (4.4) | 


Dubai, UAE 
2016 | 508 (21) | 42 © P58) | 85 O 
2011 | 4602.5) L488 4) 


© More recent year significantly higher 


@ More recent year significantly lower 
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Exhibit 3.5 and 3.6: Trends in the Comprehension Processes 


Trends in average reading achievement for the retrieving and straightforward inferencing and the 
interpreting, integrating, and evaluating reading comprehension processes are presented for the 
countries that have comparable data from previous PIRLS assessments. Exhibit 3.5 depicts the results 
graphically for the countries in alphabetical order, while Exhibit 3.6 provides the detailed results 
from assessment to assessment. Mirroring the overall results, the trends in reading achievement for 
both process scales show more gains than losses. Twenty countries have data for the 15 year period 
between 2001 and 2016, with 10 showing increases in retrieving and straightforward inferencing 
and 2 decreases. Similarly, 10 had increases in interpreting, integrating, and evaluating and 3 had 
decreases. Of the 20 countries, 15 had the same trend result for both processes. 

Forty-one of the countries participated in both 2011 and 2016, with 18 showing improvements 
in the retrieving and straightforward inferencing comprehension process and 8 showing decreases. 
Compared to five years earlier, 18 countries had higher achievement in 2016 in the interpreting, 
integrating, and evaluating process and 10 had lower achievement. The within country trends were 
the same for the two processes in 30 of the 41 countries. 
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Exhibit 3.5: Trends in Achievement by Comprehension Process 
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Exhibit 3.5: Trends in Achievement by Comprehension Process (Continued) 


Retrievingand =@== _Interpreting, 
Straightforward Inferencing Integrating, and Evaluating than other comprehension process 
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* Achievement significantly higher 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 3.5: Trends in Achievement by Comprehension Process (Continued) 
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Exhibit 3.5: Trends in Achievement by Comprehension Process (Continued) 
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Exhibit 3.5: Trends in Achievement by Comprehension Process (Continued) 


Retrievingand === — Interpreting, =mmjjjjem * Achievement significantly higher 
Straightforward Inferencing Integrating, and Evaluating than other comprehension process 
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Exhibit 3.5: Trends in Achievement by Comprehension Process (Continued) 
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Exhibit 3.6: Differences in Achievement for Comprehension Processes 
Across Assessment Years 


Instructions: Read across the row to determine if the performance in the row year is significantly higher (Q) or 
significantly lower (®) than the performance in the column year. 


Retrieving and Straightforward Inferencing Interpreting, Integrating, and Evaluating 
Country Average Differences Between Years Average Differences Between Years 
Australia 


2016_| 54126 | 4 [| 5492.4) | 208 
2011 | 527(26)_ L529.) 


Austria 
2016_| 55028) | uO [2 [yt sae [| wot 6 [ 
2011 | 53923) [9 © Psat) [8 © 
2006 | 548 (2.2) | L528 25) 


Azerbaijan 
2016 | 47644) | 7 [es te) 4 © 
2011_ | 469 (3.2) i | 249 (3.7) [a 
Belgium (Flemish) 
2016_ | 5262.1) [i -23 © GR | 52402) 22 © 
2006 | _549 (2.1) | L547 0.9) 


Belgium (French) 


ne 2016 | sani) | 2 5s) 8 © 
2 2011_|__—543 (15) i |__ 554 (1.5) [i 


Chinese Taipei 


Finland 


2016 | 57220) | 8 | | 562(18) [5 
2011_[__569 (2.0) [ST ) L__ 5670.8) TT 


France 
501 (2.4) 2 © 
512 (2.8 


8) 


© More recent year significantly higher 


@ More recent year significantly lower 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Trend results for Azerbaijan do not include students taught in Russian. Trend results for Lithuania do not include students taught in Polish or in Russian. 
See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 3.6: Differences in Achievement for Comprehension Processes 
Across Assessment Years (Continued) 


Instructions: Read across the row to determine if the performance in the row year is significantly higher (Q) or 
significantly lower (®) than the performance in the column year. 


Retrieving and Straightforward Inferencing Interpreting, Integrating, and Evaluating 
Country Average Differences Between Years Average Differences Between Years 
Scale Score 2011 Scale Score 2011 | 2006 | 


as eeu | 
Georgia 
LF) 4902.9) =a 
| 4918.0) P| 
PL 4568.5)_ | P| 
0 || 5308.2) | 
PL 535:(2.0) 


56221) 
| 56125) | 
| 5253.1) 


Ireland 


2016 | 566026 | MO | | fj) 56929) | 168 
2011 | 552(28) [TT 55323) [TT 
Israel 


2016 | 530(24) | 8 © P3027) | 13 @ PT 
2011 | 538 (2.8) I 58 2.9) 


Italy 
pS 55027) | sO] 6 | 8 
| 544(20) [ee | 3 
5563.0) | | 6 OO 


PL 47) | 


2016 | 42.) [9 © TT | asic) | 
2011 | 4612.4) [Ls 


Morocco 
2016 | 364039) | 39 @ || 33645) | 48 © PO 
2011 | 3253.1) es | 283 (43) 


© More recent year significantly higher 


@ More recent year significantly lower 


)K Reservations about reliability of average achievement because the percentage of students with achievement too low for estimation exceeds 25%. 
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Exhibit 3.6: Differences in Achievement for Comprehension Processes 
Across Assessment Years (Continued) 


Instructions: Read across the row to determine if the performance in the row year is significantly higher (Q) or 
significantly lower (®) than the performance in the column year. 


Retrieving and Straightforward Inferencing Interpreting, Integrating, and Evaluating 
Country Average Differences Between Years Average Differences Between Years 
Scale Score } 2011 | 2006 | 2001 | Scale Score } 2011 | 2006 2001 
Netherlands 


901 [non 5®| we || sei) [em 1 | so 
07) | | || se) | (| 100 
3900 | |  (mmmi| sxe) | | (=o 


Pos) | 68] 6 | 3 0 © 
760) os or) 
3703) | 2 || 3703) | 
3565) | i [G9 (Pd 


Northern Ireland 


2016 | 520) | 6 [om | s707 | 5 [=u 
201 | 3505 [i ) || 2c) || 


Norway (4) 
2016 00 
#2011 5.8) Ts 502 (2.6) 
F 2006 | 5626) SSS) SB) 
2001 | _508 (2.9) | L492. 8.0) 
Oman 
2016 | 4193.2) [25 © | 4s) 33 © PT 
y 2011 | 3504 | | || 6) fo CS 
Portugal 
2016 | 5822) | "®] ||| eM | WO] 7 | 
2011 | 539 (2.8) [L542 2.6) 
Qatar 
2016 130 | 
2011 ad 


Russian Federation 


~ 58103) | 60] 0 | 
s608) [DD |) 0 
=a) 
as 


| 5717) [oy 8 
3404 | nO 

| 53343) [a | 52448) [TE 
Saudi Arabia 


2016 | 425 (41) |B | 4394.1) | 15 © | 
2011 | 43345) | 446) PO 


56584) | 
| 
— 
= 

Singapore 

336) [8 90 | 5962 | 9 [| nol 30 | 
eSanesor 
| O 
00 | 
| 8 O 
| 


565 6.4) 
Ecc 
- 

3 


Slovak Republic 
3 


Slovenia 


- 3300) [nn 
| 
- 


© More recent year significantly higher 


@ More recent year significantly lower 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


W Reservations about reliability of average achievement because the percentage of students with achievement too low for estimation does not exceed 25% but exceeds 15%. 
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Exhibit 3.6: Differences in Achievement for Comprehension Processes 
Across Assessment Years (Continued) 


Instructions: Read across the row to determine if the performance in the row year is significantly higher (Q) or 
significantly lower (®) than the performance in the column year. 


Retrieving and Straightforward Inferencing Interpreting, Integrating, and Evaluating 
Country Average Differences Between Years Average Differences Between Years 
Scale Score 2011 | 2006 | 2001 | Scale Score 2011 2006 2001 
South Africa 


2016 | 3204s) [1 | 3085.3) 13 
2017 | 32343) [L222 5) 
| 9) | 19 [17 © PT 

3 


| 5102.3) 3 
51328) 


United Arab Emirates 
2o1e | 44832) | 99 | | 45383) | 5 O | 
2011__| 439 (2.3) es | 438 (2.3) 


United States 


Benchmarking Participants 


Ontario, Canada 


Eng/Afr/Zulu - RSA (5) 
2016 | 40761) | | BO | | 0062) | | TO | 
2006_ | 355(84)_— [| 38 8) 


Andalusia, Spain 
2016 | s22(.9)_ ff 52723) | © 


2011 |__ 51823) [TL 510.23) 
Abu Dhabi, UAE 


2016 | 41346) | cy) 8 
2011 | 424 (4.5) L425 4.6) 
Dubai, UAE 


2016 [51224 | 34 © | {siggy | 5s © 
2011 | 47823) L442) eee 


© More recent year significantly higher 


@ More recent year significantly lower 
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Exhibit 3.7: Achievement in Reading Purposes and Comprehension Processes 
by Gender 
At the fourth grade, girls have a greater advantage compared to boys in literary reading than in 
informational reading. Exhibit 3.7 shows that girls had higher average achievement than boys in 
literary reading in 48 of the 50 PIRLS countries—all except two where reading achievement was 
similar for girls and boys. In informational reading, achievement was similar for girls and boys in 
12 countries (although girls had higher achievement in the rest). They have a similar advantage 
in the two comprehension processes—higher reading achievement than boys in retrieving and 


straightforward inferencing in 47 countries and in interpreting, integrating, and evaluating in 48 
countries. Boys did not have higher achievement than girls for either comprehension process. 
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Exhibit 3.7: Achievement in Reading Purposes and Comprehension 
Processes by Gender 


Reading Purposes Comprehension Processes 


Country titers Gerson Retrieving and Interpreting, Integrating, 
ui Straightforward Inferencing and Evaluating 


ee 


2 
a 
é 
2 
Australia 561 (2.7) © 2.9) 7) @ 533 (2.9 552 (2.7) 530 (3.0) 561 (2.6) © 538 (2.7) 3 

2 Austria 550 (2.6) © =a 6) 540 (2.9) 538 (2.9 552 (3.1) 549 (3.3) 539 (2.5) © 530 (3.3) 3 
Azerbaijan 472 (4.1) © 460 (4.2) 485 (4.7) © = 471 (5.2 484 (4.4) © 471 (4.5) 472 (4.5) © 458 (4.7) = 
Bahrain 462 (3.5) © 413 (4.0) 472 (2.6) © 434 (3.4 464 (2.8) © 425 (3.6) 469 (3.3) © 422 (3.8) s 
Belgium (Flemish) 530 (2.3) @ 517 (2.5) 529 (2.3) @ 522 (2.2 529 (2.4) © 522 (2.5) 529 (2.3) © 519 (2.5) E 

2 Belgium (French) 512 (2.6) © 496 (2.6) 494 (2.9) © 486 (2.8 506 (2.5) @ 496 (3.0) 500 (2.5) © 488 (3.1) = 
Bulgaria 561 (5.2) © 542 (4.6) 561 (4.6) O 547 (4.5 557 (4.5) © 544 (4.2) 560 (4.9) © 545 (4.3) 3 

12 Canada 556 (2.3) © 538 (2.1) 543.(25) © 537 (21 546 (2.2) © 537 (1.9) 552 (2.2) ©@ 539 (2.1) 2 
Chile 511 (2.8) © 491 (3.6) 490 (3.0) @ 481 (3.7 502 (2.9) © 490 (3.3) 500 (3.3) © 483 (3.9) a 
Chinese Taipei 555 (2.4) © 543 (2.2) 570 (2.7) 568 (2.3 565 (2.5) © 555 (2.0) a (2.4) © 555 (2.7) a 
Czech Republic 554 (2.3) © 536 (2.6) 544 (2.3) 538 (3.1 556 (2.5) © 546 (2.9) 44 (2.6) © 532 (2.5) ra 

2 Denmark 560 (2.6) © 542 (2.7) 548 (3.0) O 539 (2.9 556 (2.7) © 544 (2.6) ae (2.6) © 539 (2.7) 3 
Egypt 348 (5.4) © 308 (6.6) 350 (5.6) O 314 (7.0 347 (5.5) © 311 (6.6) 359 (5.8) @ 321 (6.6) " 
England 572 (2.7) @ 553 (2.5) 562 (2.64) @ 551 (2.7 563 (2.4) © 549 (2.5) 569 (2.4) © 554 (2.3) 
Finland 576 (2.0) © 554 (2.4) 579 (2.1) @ 559 (2.6 582 (2.3) © 562 (2.6) 573 (2.0) © 552 (2.3) 
France 518 (2.9) © 507 (2.8) 513 (2.8) 508 (2.9 524 (2.8) © 517 (2.6) 506 (2.9) © 496 (3.1) 

1 Georgia 501 (2.5) © 479 (3.5) 495 (3.1) @ = 478 (4.1 495 (2.6) © 477 (3.3) 501 (2.7) @ 479 (3.8) 
Germany 551 (3.5) © 534 (3.8) 536 (3.6) 530 (3.8 550 (3.5) © 541 (3.8) 537 (3.5) © 524 (3.8) 

2 t Hong Kong SAR 569 (3.3) © 557 (3.7) 580 (3.1) 573 (3.3 571 (2.9) © 565 (3.3) 574 (3.1) © 563 (3.3) 
Hungary 566 (3.4) © 549 (3.1) 555 (3.9) O 547 (3.5 558 (3.7) © 545 (3.5) 563 (3.5) © 550 (3.2) 
Iran, Islamic Rep. of 457 (4.6) © 407 (5.1) 446 (4.5) © 406 (5.0 454 (4.6) © 408 (5.1) 450 (4.8) © 403 (5.1) 
lreland 580 (3.2) © 563 (3.4) 569 (3.2) O 561 (3.4) 571 (3.2) @ 561 (3.5) 576 (3.4) © 562 (3.6) 

3 Israel 541 (3.4) © 523 (3.8) 533 (3.0) 525 (3.4) 536 (2.8) © 523 (3.4) 537 (3.2) © 523 (3.6) 

Italy 554 (2.4) O 543 (2.8) 551 (2.7) 547 (2.6 550 (2.3) © 544 (2.8) 554 (2.4) © 545 (2.4) 
Kazakhstan 535 (3.0) © 520 (2.6) 547 (3.1) @ 540 (3.0 534 (2.9) © 525 (2.8) 548 (3.0) © 537 (2.5) 
Kuwait 405 (4.9) © 370 (6.6) 415 (5.0) © 381 (6.9 410 (4.7) © 377 (6.5) 406 (5.2) © 369 (6.7) 

2 Latvia 565 (2.2) © 545 (2.1) 569 (2.3) © 553 (2.1 562 (2.3) © 546 (2.5) 571 (2.1) © 553 (1.9) 
Lithuania 558 (2.9) © 536 (3.1) 561 (2.9) O 541 (3.1 560 (2.7) © 539 (3.0) ae (2.7) © 537 (3.0) 
Macao SAR 538 (2.3) 534 (2.0) 555 (1.8) 556 (1.6 548 (1.8) 550 (1.4) 44 (2.2 542 (1.8) 

2 Malta 466 (3.0) © 439 (2.2) 461 (2.5) @ 443 (2.6 463 (2.5) © 441 (2.3) ta (2.9) @ 441 (2.1) 
Morocco 369 (4.3) © 338 (4.4) 372 (43) © 346 (43 378 (4.0) © 350 (4.4) 352 (4.6) © 321 (5.2) 

t Netherlands 553 (1.8) © 539 (2.4) 549 (2.4) @ 540 (2.6 551 (2.6) © 542 (2.3) 550 (1.8) © 538 (2.3) 

New Zealand 539 (2.5) © 512 (3.0) 528 (2.9) @ 512 (3.4 530 (2.5) @ 512 (3.1) 536 (2.8) © 513 (2.9) 
Northern Ireland 582 (3.0) © 559 (3.1) 569 (3.1) @ 552 (3.3 570 (2.6) © 553 (3.0) 577 (2.6) @ 558 (3.0) 
Norway (5) 571 (2.7) © 550 (3.2) 568 (2.8) © 549 (2.9 570 (2.7) © 553 (3.0) 568 (2.8) © 548 (2.5) 
Oman 434 (3.4) © 387 (3.8) 448 (3.3) O 403 (3.9 442 (3.1) © 397 (3.9) 439 (3.6) © 391 (4.2) 
Poland 577 (2.4) © 556 (2.8) 573 (2.9) © 556 (3.1 568 (2.6) © 551 (2.6) 580 (2.7) © 559 (2.8) 

2 Portugal 529 (2.8) 527 (2.8) 527 (2.9) 529 (2.7 527 (2.6) 528 (2.6) 528 (2.8 525 (2.8) 

Qatar 453 (2.3) O 415 (3.8) 466 (2.0) O 433 (3.8 460 (2.0) © 424 (3.4) 458 (2.2) © 423 (3.4) 
Russian Federation 587 (2.5) © 572 (2.5) 591 (2.3) © 578 (2.7 588 (2.5) © 575 (2.8) 589 (2.4) © 575 (2.6) 
Saudi Arabia 461 (5.1) @& 401 (5.7) 465 (5.8) © 395 (6.5 458 (5.4) © 395 (5.7) 472 (5.5) © 408 (5.8) 

3 Singapore 586 (3.6) © 563 (3.7) 586 (3.5) @ 571 (3.7 580 (3.4) © 566 (3.6) 589 (3.4) © 568 (3.4) 
Slovak Republic 545 (3.6) © 533 (3.1) 535 (3.6) O 528 (3.2 542 (3.4) © 533 (3.3) 538 (3.4) © 525 (3.6) 
Slovenia 552 (2.9) © 531 (2.8) 552 (2.6) O 536 (2.6 554 (2.7) © 539 (2.8) 550 (3.1) © 529 (2.8) 

South Africa 352 (4.2) © 296 (5.5) 340 (4.0) O 290 (5.2 348 (4.1) © 297 (5.1) 338 (5.4) © 281 (5.8) 
Spain 536 (1.7) @ 524 (2.9) 529 (1.5) 525 (2.4) 530:(15) © 523°(2:5) 534 (1.5) @ 525 (2.7) 
Sweden 564 (2.7) © 548 (2.7) 562 (3.3) O 548 (2.8 566 (3.1) © 555 (3.0) 562 (2.7) @ 544 (2.8) 
Trinidad and Tobago 489 (4.0) © 466 (4.5) 490 (3.8) © 469 (4.7 495 (4.1) © 471 (4.6) 482 (4.2) © 461 (4.9) 
United Arab Emirates 456 (4.2) 5 425 (4.6) 474 (4.2) © 446 (4.6 463 (4.1) 5 434 (4.5) 468 (4.3) © 438 (4.5) 
t United States 563 (3.5) 552 (3.5) 546 (3.2) 540 (3.7, 547 (3.1) 539 (3.5) 559 (3.3) © 551 (3.5) 


International Avg. By7A(\s)) 499 (0.5) BEN) 503 (0.5) SYA () By (9) BYAUK (1) et 4) Bes (0) 


© Average significantly higher than other gender 


See Appendix C.1 for target population coverage notes 1, 2, and 3. See Appendix C.4 for sampling guidelines and sampling participation notes t, +, and =. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 3.7: Achievement in Reading Purposes and Comprehension 


Processes by Gender (Continued) 


Country 


Reading Purposes 


Literary 


Benchmarking Participants 


Buenos Aires, Argentina 491 (3.7) © 
Ontario, Canada 558 (3.8) © 
= Quebec, Canada 558 (3.2) O 
2 Denmark (3) 516 (3.5) @ 
Norway (4) 531 (2.6) © 
Moscow City, Russian Fed. 624 (2.6) © 
Eng/Afr/Zulu - RSA (5) 418 (6.2) © 
Andalusia, Spain 529 (2.8) © 
2 Madrid, Spain 556 (2.7) © 
Abu Dhabi, UAE 428 (7.2) © 
Dubai, UAE 516 (3.8) © 
° 


Downloaded from http://pirls2016.org/download-center/ 


477 (3.3) 
540 (4.0) 
540 (3.3) 
494 (2.8) 
510 (2.3) 
603 (2.4) 
386 (6.9) 
522 (2.4) 
545 (2.7) 
386 (6.6) 
501 (3.1) 


Informational 


477 (3.8) 
543 (4.0) 
549 (3.5) 
506 (3.3) 
520 (2.8) 
620 (2.6) 
421 (6.0) 
523 (2.9) 
550 (2.5) 
443 (7.3) 
529 (3.8) 


coco 


(A) 
4) 


) 
536 (4.0) 
544 (3.3) 
490 (2.8) 
508 (2.2) 
606 (3.0) 
393 (6.5) 
524 (2.4) 
548 (2.6) 
404 (7.1) 
518 (2.7) 


Average significantly higher than other gender 


Retrieving and 
Straightforward Inferencing 


487 (3.4) 
544 (3.7) 
555 (3.4) 
511 (3.1) 
530 (2.8) 
620 (2.2) 
421 (6.1) 
523 (2.6) 
549 (2.4) 
433 (7.1) 
518 (3.8) 


coococcoo 


oo 


479 (3.1) 
534 (3.7) 
546 (3.3) 
489 (2.9) 
513 (2.2) 
603 (3.2) 
393 (6.6) 
521 (2.1) 
544 (2.5) 
395 (6.3) 
506 (3.2) 


ZF 
iF 


Interpreting, Integrati 
and Evaluating 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


478 (4.2) © 468 (4.1) 
555 (3.5) © 542 (3.7) 
551 (3.4) © 538 (3.3) 
510 (3.3) © 497 (2.8) 
521 (2.4) © 504 (2.0) 
622 (2.4) © 606 (2.4) 
417 (5.9) © 383 (7.1) 
529 (3.3) 525 (2.2) 
554 (2.3) © 546 (2.6) 
438 (7.3) © 398 (6.3) 
526 (3.5) © 512 (2.9) 
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GOAT ER: 
HOME ENVIRONMENT) 
SUPPORT: 


PIRLS ZU10 INIERNATIONAL RESULIS 
IN REAUING 


yy TIMSS foe PIRLS 

YY natio 

4 IEA | =enSEAes "fEahacati 
BOSTON COLLEGE 


READING-FOURTH GRADE PRLS 


PANS 
Supportive Home Environment for Learning 


Percent of 
Home Resources students 
for Learning 
Many 
om 
Students whose parents G 
reported many home Fi 
resources for learning 2 
had much higher 2 
achievement than Some a 
students whose parents § 
reported some or few = 
resources. 
Few 
Percent of 
Early Literacy students 
Activities 
Students whose parents 
reported often spending Often rT 
time with them on early £ 
literacy learning activities 5 
had higher achievement. = «) 
PIRLS shows a trend toward S 
more parental F e 
involvement in Sometimes ui 
children's literacy = 
development. 
Never or 
Almost Never 
In 16 countries, there was an increase in lin 
b students’ time spent on early literacy learning 
activities. Only 1 country had a decrease. 
Percent of 
Students’ Parents students 
Like to Read 
Very Much 
Like ~ 
Students whose 5 
parents reported a 5 e 
greater enjoyment of a 
reading had higher s 
achievement than rons a 
students with parents s 
who liked reading less 2 
or disliked reading. 
Do Not Like 


parents’ positive attitudes toward reading. 


In 31 countries, there was a decrease in 
Only 2 countries had an increase. 


0 


An Early Start in School 


Preprimary 
Education 

There was a positive 
relationship for 
students between 
the number of years 
they attended 


preprimary education 1 2% 1 1 % 


programs and their 


a : Average Average Average 
reading achievement. [Achievement (i Achievement (| Achievement 
EN'Y/ 498 472 


3 Years 2 Years 1Year Did Not 


or More or Less Attend 
Could Do Literacy Py 
Tasks When 
Beginning 


Primary School 


Parents’ reports on 
whether students could 


35% 36% 


perform early literacy Moderately | 

tasks when beginning Well Well 

primary school illustrate 537] 485 

that early preparation 

Average Average Average 

appears to have an Achievement Achievement Achievement 

effect through the 

fourth grade. | 
SOURCE: IEA's Progress in International Reading Z IEA TIMSS.6 EIRES 
Literacy Study - PIRLS 2016 @ Lynch School of Education 
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CHAPTER 4 


Home Environment Support 


Exhibit 4.1 and 4.2: Home Resources for Learning 


The Home Resources for Learning scale combines data reported by students and their parents. The 
parents’ data were collected using the PIRLS 2016 Learning to Read Survey in which students’ 
parents were asked to provide information about their child’s experiences learning to read. As 
explained in Exhibit 4.1, students provided information about the number of books in the home 
and other study supports, while the parents provided information about the number of children’s 
books, the parents’ levels of education, and their occupations. As also explained, students were 
assigned a score on the scale according to the availability of these five home resources for learning. 

The PIRLS 2016 results add to the already extensive amounts of research showing a powerful 
positive relationship between students’ socioeconomic environment and their educational 
achievement. 

In Exhibit 4.1, countries are ordered by the percentage of students in the Many Resources 
category. However, on average, almost three-fourths of the students (73%) were assigned to the Some 
Resources category. Twenty percent were in the Many Resources category and 7 percent were in the 
Few Resources category, with a 140-point difference in their average reading achievement (572 vs. 
432). Average reading achievement for the students in the Some Resources category was in between, 
at 509 points. The scatterplot on the third page of the exhibit shows the relationship between average 
reading achievement and home resources for learning for each country. 

Exhibit 4.2 presents information about students’ access to digital devices in the home. The 
percentages of students with High, Medium, and Low Access mirror the percentages with Many, 
Some, and Few Resources. There was a 122-point difference in average reading across the categories 
of digital access (536 vs. 414), with very low average achievement for those having low access. 
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Exhibit 4.1: Home Resources for Learning WAU ip crade 


Students Categorized by Parents' and Students' Reports 

Students were scored according to their own and their parents’ responses concerning the availability of five resources on the 
Home Resources for Learning scale. Students with Many Resources had a score of at least 11.8, which is the point on the scale 
corresponding to students reporting they had more than 100 books in the home and both of the home study supports, and 
parents reporting that they had more than 25 children's books in the home, that at least one parent had finished university, and 
that at least one parent had a professional occupation, on average. Students with Few Resources had a score no higher than 7.5, 
which is the scale point corresponding to students reporting that they had 25 or fewer books in the home and neither of the home 
study supports, and parents reporting that they had 10 or fewer children's books in the home, that neither parent had gone 
beyond upper-secondary education, and that neither parent was a small business owner or had a clerical or professional 
occupation, on average. All other students were assigned to the Some Resources category. 


Many Resources Some Resources Few Resources 


Difference in 
Average Scale Score 


Average 
Scale Score 


Country Percent Average Percent Average Percent Average 
— Achievement | of Students | Achievement | of Students | Achievement 


from 2011 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Norway (5) 2 581 (2.3) (1.2) 544 (2.5) 4 (0.04) -- 
Sweden r : : = 586 (2.3) 56 (1.7) 542 (2.7) se ~~ 4(0.05) r 0.0 (0.08 
Denmark 4] (1.4) 575 (2.2) 58 (1.4) 535 (2.5) 1 i ~~ 3 (0.05) 0.0 (0.07 
Finland 37 (1.2) 594 (2.0) 63 (1.1) 555 (2.0) 0 (0.1 ~~ - (0.03) 0.0 (0.06 
Canada r 35 (1.0) 579 (1.9) 65 (1.0) 536 (1.9) 1 (0.1 ~~ 1.2 (0.03) r -0.2 (0.05) @ 
Ireland 33 (1.4) 607 (2.5) 66 (1.4) 555 (2.2) 1 (0.3 ~~ 1.0 (0.05) 0.2 (0.08 
Netherlands s 33 (1.5) 577 (2.5) 67 (1.5) 541 (2.5) 0 (0.1 ~~ 1.0 (0.05) s 0.2 (0.08 
Belgium (French) 30 (1.3) 540 (2.5) 67 (1.2) 486 (3.0) 4 (0.4) 439 (7.5) .7 (0.05) 0.0 (0.10 
Singapore 29 (0.9) 624 (3.3) 69 (0.8) 562 (3.3) 2 (0.2 ~~ 0.9 (0.03) 0.2 (0.05) © 
Hungary 28 (1.7) 603 (2.8) 65 (1.7) 543 (2.5) 6 (0.8 467 (6.6) .6 (0.09) 0.5 (0.13) © 
Belgium (Flemish) 27 (1.2) 560 (2.1) 71 (1.1) 519 (1.9) 2 (0.3 ~~ 0.8 (0.05) -- 
Germany S$ 25-(15) 591 (3.4) 74 (1.5) 539 (2.8) 1 (0.2 ~~ 0.8 (0.06) s 0.1 (0.09 
France i. (1.3) 552 (3.5) 73 (1.3) 505 (2.1) 2 (0.3 ~~ 0.6 (0.05) 0.0 (0.08 
Malta 23 (0.7) 486 (2.9) 76 (0.7) 455 (2.0) 1 (0.2 ~~ 0.7 (0.02) + 0.6 (0.03) O 
Israel 22 (1.3) 588 (3.0) 76 (1.3) 523 (2.9) 1 (0.2 ~~ 0.9 (0.06) + 0.1 (0.08 
Austria 2212) 584 (2.8) 7th 533 (2.2) 2 (0.2 ~~ 0.6 (0.05) 0.2 (0.08 
Slovenia 22 (1.1) 587 (2.6) 77 (1.1) 534 (2.1) 1 (0.2 ~~ 0.6 (0.04) 0.2 (0.06) © 
Czech Republic 212) 587 (2.0) 77 (1.2) 536 (1.8) 2 (0.3 ~~ 0.5 (0.05) 0.0 (0.07 
Poland 21 (0.9) 605 (3.1) 76 (1.0) 556 (2.1) 3 (0.4 509 (10.1) 0.4 (0.05) -- 
Chinese Taipei 21 (1.3) 593 (2.8) 74 (1.2) 553 (1.9) 5 (0.4 513 (6.7) 0.3 (0.06) 0.1 (0.08 
Hong Kong SAR 21 (1.8) 579 (4.9) 74 (1.8) 568 (3.0) 5 (0.5 553 (7.3) 0.3 (0.08) 0.5 (0.11) 
Latvia 21 (1.0) 589 (2.4) 77 (1.0) 552 (1.8) 2 (0.3 ~~ 0.6 (0.04) -- 

Spain 9 (0.7) 565 (1.8) 77 (0.8) 526 (1.7) 4 (0.5 476 (5.1) 0.3 (0.04) 0.0 (0.07 
Portugal 8 (1.0) 568 (4.2) 76 (0.9) 523 (2.2) 6 (0.5 487 (4.3) 0.1 (0.05) 0.2 (0.08) © 
Lithuania 6 (1.0) 594 (3.5) 81 (1.1) 543 (2.6) 3 (0.6 466 (8.1) 0.2 (0.05) 0.4 (0.07) © 
Slovak Republic 6 (0.9) 592 (3.4) 77 (1.4) 539 (2.2) 8 (1.1 397 (13.5) 0.1 (0.05) 0.1 (0.08 
Bulgaria 5 (1.1) 610 (3.9) 71 (1.8) 558 (3.4) 14 (1.8 466 (10.3) 9.8 (0.09) 0.4 (0.15 
Russian Federation 4 (0.8) 618 (3.2) 84 (0.8) 576 (2.2) 2 (0.3 ~~ 0.3 (0.04) -0.1 (0.06 
United Arab Emirates 2 (0.5) 539 (4.7) 85 (0.5) 450 (3.0) 3 (0.2 369 (8.3 0.2 (0.03) 0.2 (0.05) © 
Georgia 2 (0.9) 529 (4.3) 82 (1.2) se (2.9) 6 (0.9 439 (7.9 0.0 (0.05) 0.1 (0.09 
Qatar r (0.5) 519 (3.9) 86 (0.6) 449 (2.0) 3 (0.3 363 (8.6 0.2 (0.02) + 0.0 (0.05 
Macao SAR 11 (0.4) 581 (3.7) 81 (0.6) 542 (1.1) 7 (0.4 530 (3.4) 9.8 (0.02) -- 
Trinidad and Tobago r 10 (0.8) 554 (5.1) 86 (0.9) 480 (3.6) 4 (0.4) 430 (10.2) 0.0 (0.04) + 0.2(0.07) O 
Italy 8 (0.8) 595 (3.3) 86 (0.9) 550 (2.2) 6 (0.6 507 (6.2 9.7 (0.05) 0.0 (0.07 
Bahrain 8 (0.6) 519 (6.2) 87 (0.6) 447 (2.7) 5 (0.4 388 (7.2 9.8 (0.03) -- 
Kazakhstan 8 (0.9) 573 (7.1) 88 (1.0) 534 (2.3) 4 (0.6 516 (7.4) 9.9 (0.05) -- 

Chile 6 (0.4) 557 (4.4) 85 (0.8) 497 (2.6) 10 (0.7 461 (6.8 9.3 (0.05) -- 

Oman 5 (0.4) 505 (7.8) 81 (0.7) a (3.3) 14 (0.6 368 (4.7 9.3 (0.03) 0.6 (0.05) © 
Iran, Islamic Rep. of 4 (0.5) 525 (5.8) 67 (1.4) 449 (3.5) 29 (1.4) 373 (5.4 8.5 (0.06) 0.4 (0.11) © 
Kuwait r 3 (0.6) 479 (12.3) 92 (0.9) 401 (4.2) 5 (0.7 365 (13.7) 9.6 (0.05) -- 

Saudi Arabia 2 (0.3) ~~ 85 (1.0) 436 (4.0) 13 (1.1 418 (11.5) 9.1 (0.05) 0.1 (0.09) 
Azerbaijan 2 (0.2) ~~ 75 (1.0) 486 (3.6) 24 (1.1 440 (6.4 8.7 (0.05) 0.2 (0.07) 
Morocco r 1 (0.1) ~~ 38 (1.2) 401 (3.5) 61 (1.2 342 (4.8 6.9 (0.06) s -0.2 (0.11) 
Egypt 0 (0.1) ~~ 61 (1.8) 366 (5.4) 38 (1.8 277 (8.3 9 (0.08) -- 
England -- -- -- -- -- -- -- 
United States cs ee =a a) == a S oo 
Australia X ra 6) 592 (3.4) 53 (1.6) 541 (3.1) 1 (0.2 ~~ 11.6 c 06) x 0.0 (0.08) 
Northern Ireland x aS} 615 (4.3) 57 (1.5) 569 (3.7) 1 (0.2 ~~ 11.4 (0.05) x 0.5 (0.09) © 
New Zealand X 39 (1.4) 581 (3.2) 60 (1.4) 522 (3.0) . 0.4 ~~ 7 2 (0.05) x 0.0 (0.07) 
South aul: X ue 4) ~~ 70 (1. ; 354 (6.4) at 7 295 a ; 3 (0.07) x -0.1 (0.10) 


This PIRLS questionnaire scale was established in 2011 based on the combined response distribution of all countries that Significantly higher than 2011 © 
participated in PIRLS 2011. To provide a point of reference for country comparisons, the scale centerpoint of 10 was located Significantly lower than 2011 © 
at the mean of the combined distribution. The units of the scale were chosen so that 2 scale score points corresponded to 

the standard deviation of the distribution. 

() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 

A dash (-) indicates comparable data not available. A tilde (~) indicates insufficient data to report achievement. 


An “r" indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are 
available for at least 50% but less than 70% of the students. An “x” indicates data are available for less than Lg TIMSS & FIRLS 148 
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Exhibit 4.1: Home Resources for Learning (Continued) 


Average 
Country Percent Average Percent Average Percent Average ies 
cale Score 
of Students | Achievement | of Students | Achievement | of Students | Achievement 


Benchmarking Participants 


Norway (4) 44 (1.4) 543 (2.3) 56 (1.4) 501 (2.3) 1 (0.1 aie 11.4 (0.04) 
Denmark (3) 41 (1.4) 527 (3.2) 58 (1.4) 488 (3.2) 1 (0.2 =e 11.3 (0.05) 
Moscow City, Russian Fed. 37 (1.7) 633 (2.1) 62 (1.7) 600 (2.2) 0 (0.1 ~~ 11.3 (0.05) 
Ontario, Canada r 36 (2.0) 580 (3.6) 63 (2.0) 535 (3.3) 0 (0.2 ie a 2 (0.06) 
Quebec, Canada 31 (1.9) 577 (3.4) 68 (1.9) 540 (2.6) 1 (0.2 raid 11.1 (0.06) 
Madrid, Spain 30 (1.6) 576 (2.7) 67 (1.5) 543 (1.9) 2 (0.4 ae i 8 (0.06) 
Dubai, UAE 21 (0.5) 579 (2.4) 77 (0.5) 509 (2.2) 2 (0.1 ~ om 10.7 (0.02) 
Andalusia, Spain 15 (1.2) 563 (2.6) 79 (1.1) 526 (1.8) 6 (0.6 477 (6.4) 10.0 (0.06) 
Buenos Aires, Argentina Ss 14 (1.2) 544 (4.5) 79 (1.2) 486 (3.1) 8 (0.6 432 (6.7) 10.0 (0.07) 
Abu Dhabi, UAE r 10 (0.8) 505 (9.2) 87 (0.9) 420 (4.0) 3 (0.4 330 (13.5) 10.0 (0.04) 
Eng/Afr/Zulu - RSA (5) s 3 (0.9) 564 (11.0) 75 (1.8) 439 (7.8) 22 (2.0 370 (5.0) 8.7 (0.11) 


Significantly higher than 2011 © 
Significantly lower than 2011 @ 


Number of books in the home (students): Number of children's books in the home (parents): 
1) 0-10 1) 0-10 

2) 11-25 2) 11-25 

3) 26-100 3) 26-50 


Average Scale Score 


r 


r 


Number of home study supports (students): Highest level of education of either parent (parents): 


1) None 


- 1) Finished some primary or lower secondary 
2) Internet connection or own room 


or did not go to school 
2) Finished lower secondary 
3) Finished upper secondary 
4) Finished post-secondary education 


Highest level of occupation of either parent (parents): 


1) Has never worked outside home for pay, general laborer, or semi-professional (skilled agricultural or 
fishery worker, craft or trade worker, plant or machine operator) 

2) Clerical (clerk or service or sales worker) 

3) Small business owner 


Few 
Resources 


Difference in 


from 2011 


-0.1 (0.07 


-0.1 (0.09 
0.0 (0.08 
0.1 (0.03 
0.2 (0.09) 


0.2 (0.08) © 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


TIMSS & PIRLS 


Fg 
g IEA International Study Center 
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Exhibit 4.1: Home Resources for Learning (Continued) 


Average Reading Achievement by Home Resources for Learning 


650 5 © 
a 
z 
= 
> 
Moscow City, Russian Fed. 5 
2 
600 - 35 
Z 
Russian Federation g 
Singapore @ Northern Ireland E 
Hong Kong SAR @ nland = 
Poland@® noe HY a 
Chinese Taipei@ 8 sec (5) S 
big tihng Madrid, os Sweden 2 
550 ~ Italy @ Slovenia rk L 
Macao de Cech renwic@g mag ustralia w 
Kaihstan@ ui Soa a 
Slovak ie Israel hoe Quebec, Canada 3 
Andalusia, Spain ‘ 98 afi 
z Portugal“ Dubai, a Norway (4) 
a Belgium (Flemish)~ @ France New Zealand 
wv 
x ; »Denmark.(3) 
4 500 @ hile @ Belgium (French) 
x @ Georgia 
5 Buenos Aires, Argentina 2 
a Trinidad and Tobago 
= @ Azerbaijan 
mn 
= 
a=) United Arab Emirates 
wv 
= 450 eo’ @ Malta 
a Bahrain@® 
S @ Oatar 
gS 
<— . . 
lran, Islamic Rep. of @ @ Saudi Arabia 
@ Oman 
Abu Dhabi, UAE“? 
Eng/Afr/Zulu - RSA (5) 
400 - 
@ Kuwait 
@ Morocco 
350 | 
@ Egypt 
@ south Africa 
300 - ; ; + + ' + ; + 1 
6 6.5 7 75 8 8.5 9 9.5 10 10.5 11 11.5 12 


Average Home Resources for Learning Scale Score 
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Exhibit 4.2: Digital Devices in the Home 
Students Categorized by Parents' and Students’ Reports 


Students were scored according to their own and their parents’ responses concerning the availability of four items on the Digital 
Devices in the Home scale. Students with High Access had a score of at least 12.1, which is the point on the scale corresponding to 
students reporting they had a computer and Internet connection, and parents reporting they had seven or more digital 
information devices in the home as well as a digital device for reading for both themselves and their child. Students with Low 
Access had a score no higher than 6.0, which is the scale point corresponding to students reporting that they did not havea 
computer or Internet connection, and parents reporting that they had less than four digital information devices in the home and 
no digital devices for reading for either themselves or their child. All other students were assigned to the Medium Access 


category. 


Country 


High Access 


Percent 
of Students 


Average 
Achievement 


Medium Access 


Percent 
of Students 


Average 
Achievement 


Low Access 


Percent 
of Students 


Average 
Achievement 


Average 


Scale Score 


SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 
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Norway (5) 58 (1.0) 566 (2.4) 42 (1.0) 552 (2.7) 0 (0.0) 11.8 (0.04) 
Finland 53 (0.9) 577 (2.0) 47 (0.9) 560 (2.3) 0 (0.0) ~~ 11.6 (0.03) 
Denmark 49 (1.0) 554 (2.9) 51 (1.0) 546 (2.4) 0 (0.0) ~~ 11.5 (0.04) 
Sweden 42 (1.2) 567 (2.7) 58 (1.2) 554 (2.8) 0 (0.1) ~~ 11.3 (0.05) 
Netherlands s 32 (1.3) 557 (3.4) 68 (1.3) 551 (2.3) 0 (0.0) ~~ 10.8 (0.05) 
Qatar r 29 (0.5) 474 (2.5) 69 (0.5) 44S (2.5) 1 (0.1) ~~ 10.6 (0.02) 
Belgium (Flemish) 29 (0.7) 535 (2.2) 71 (0.7) 526 (2.1) 0 (0.1) ~~ 10.6 (0.03) 
Hungary 28 (1.2) 575 (3.8) 70 (1.0) 549 (3.0) 2 (0.3) ~~ 10.6 (0.06) 
Canada r 28 (0.6) 563 (1.8) 71 (0.6) 545 (2.2) 1 (0.1) ~~ 10.6 (0.02) 
Kuwait r 28 (1.1) 411 (5.5) 71 (1.1) 397 (4.5) 1 (0.2) ~~ 10.6 (0.05) 
United Arab Emirates 26 (0.6) 474 (3.9) 74 (0.6) 451 (3.4) 1 (0.1) ~~ 10.5 (0.03) 
Ireland 25 (0.8) 580 (3.0) 75 (0.8) 568 (2.4) 0 (0.1) ~~ 10.4 (0.03) 
Bahrain 24 (0.8) 470 (3.2) 74 (0.7) 444 (2.6) 2 (0.2) ~~ 10.2 (0.03) 
Singapore 24 (0.6 605 (3.1 76 (0.6 571 (3,3 1 (0.1 ~~ 10.4 (0.03) 
Israel 23 (0.9 546 (3.4 76 (0.9 534 (3.0 2 (03 ~~ 10.3 (0.04) 
Portugal 21 (0.9 549 (4.3 78 (0.9 524 (2.1 1 (0.2 ~~ 10.4 (0.03) 
Trinidad and Tobago r 21 (1.0 514 (5.0 75 (1.0 481 (3.4 4 (0.4 417 (11.7) 10.0 (0.05) 
Spain 20 (0.6 550 (2.3 79 (0.6 526 (1.9 102 ~~ 10.1 (0.03 
Bulgaria 19 (0.8) 592 (3.3) 75 (1.0) 549 (4.3) 6 (0.9) 473 (15.8) 9.9 (0.08 
Malta 19 (0.6 468 (3.6 80 (0.6 457 (1.8 0 (0.1 ~~ 10.3 (0.02 
Poland 19 (0.8 586 (3.0 80 (0.8 561 (2.1 1 (0.3 ~~ 10.5 (0.03 
Lithuania 19 (0.9) 568 (3.7 79 (0.9) 547 (2.9 2 (0.4) ~~ 10.2 (0.05 
Slovak Republic 17 (0.6) 561 (3.4) 80 (0.7) 536 (3.0) 3 (0.6) 389 (19.9) 10.0 (0.05 
Austria 17 (0.7) 557 (3.6) 82 (0.7) 540 (2.4) 1 (0.1) ~~ 9.9 (0.03 
Latvia 17 (0.6) 572 (3.1) 82 (0.8) 556 (1.9) 1 (0.3) ~~ 10.2 (0.03 
Saudi Arabia 17 (0.9) 454 (4.6 78 (0.9) 432 (4.3 5 (0.5) 415 (12.2) 9.7 (0.06) 
Oman 16 (0.6) 452 (5.0 78 (0.6) 421 (3.4 6 (0.3) 375 (7.3) 9.5 (0.04) 
Czech Republic 16 (0.6) B57 (3.1 83 (0.6) 544 (2.2 1 (0.2) ~~ 9.9 (0.03) 
Germany S 15 (0.7) 558 (3.8) 84 (0.7) 550 (2.7) 1 (0.2) ~~ 9.7 (0.04 
Belgium (French) 15 (0.7) 507 (4.3 84 (0.7) 499 (2.8 1 (0.2) ~~ 9.9 (0.03 
Macao SAR 14 (0.5) 563 (3.0 85 (0.5) 543 (1.1 1 (0.1) ~~ 9.9 (0.02 
Italy 14 (0.7) 557 (3.7) 85 (0.8) 550 (2.3) 1 (0.2) ~~ 9.8 (0.03) 
Slovenia 13 (0.7) 568 (3.9) 86 (0.6) 541 (2.2) 1 (0.2) ~ 9.9 (0.03) 
France 13 (0.6) 516 (4.5) 86 (0.6) 514 (2.2) 1 (0.2) ~~ 9.8 (0.03 
Hong Kong SAR 13 (1.0) 577 (4.6) 87 (1.0) 569 (2.9) 1 (0.2) ~~ 9.9 (0.05 
Russian Federation 12 (0.7) 604 (3.0) 85 (0.7) 580 (2.2) 3 (0.3) 519 (11.6) 10.0 (0.04 
Chinese Taipei 11 (0.5) 575 (3.5) 87 (0.5) 559 (2.1) 2 (0.2) ~~ 9.7 (0.03) 
Kazakhstan 10 (0.8) 561 (5.0) 81 (0.9) 535 (2.4) 8 (0.8) 516 (5.6) 9.5 (0.08) 
Chile 8 (0.5) 540 (3.7) 83 (1.0) 495 (2.6) 9 (0.9) 470 (7.3) 9.0 (0.06) 
Egypt 4 (0.6) 407 (14.0) 66 (1.8) 352 (5.1) 30 (1.8) 281 (9.3) 7.8 (0.10) 
Georgia 4 (0.3) 513 (6.6) 87 (0.9) 492 (2.7) 9 (1.0) 468 (9.3) 9.0 (0.06) 
Azerbaijan 3 (0.5) 523 (6.7) 63 (1.4) 490 (3.4) 34 (1.5) 448 (5.6) 7.6 (0.08) 
Morocco 3 (0.2) 431 (7.8) 50 (1.1) 386 (3.9) 47 (1.2) 335 (4.7) 6.9 (0.07) 
South Africa 5 3 (0.5) 429 (15.6) 64 (1.5) 341 (6.3) 33 (1.6) 313 (4.5) 74 (0.09) 
Iran, Islamic Rep. of 2 (0.2) ~~ 75 (1.4) 445 (4.2) 23 (1.5) 381 (6.7) 8.1 (0.07) 
England -- -- -- -- -- -- -- 

United States os == ial == aie == pied 

Northern Ireland X 32 (1.4) 599 (5.0) 67 (1.4) 582 (3.6) 0 (0.2) ~~ 10.9 (0.06) 
Australia X 29 (1.0) 572 (4.6) 71 (1.0) 560 (3.1) 0 (0.1) ~~ 10.7 (0.04) 
New Zealand X 22 (1.0) 559 (4.2) 76 (1.1) 540 (2.8) 2 (0.3) ~~ 10.2 (0.04) 


This PIRLS questionnaire scale was established in 2016 based on the combined response distribution of all countries that participated in PIRLS 2016. To provide a 

point of reference for country comparisons, the scale centerpoint of 10 was located at the mean of the combined distribution. The units of the scale were chosen 

so that 2 scale score points corresponded to the standard deviation of the distribution. 

() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 

A dash (-) indicates comparable data not available. A tilde (~) indicates insufficient data to report achievement. 

An “r" indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are TIMSS & PIRLS 
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Benchmarking Participants 


54 (1.2) 

45 (1.1) 
Ontario, Canada r 32 (1.0) 

30 (0.5) 
Madrid, Spain 27 (0.8) 
Abu Dhabi, UAE r 26 (1.0) 
Moscow City, Russian Fed. 25 (0.9) 
Buenos Aires, Argentinas 23 (1.4) 
Quebec, Canada 19 (0.8) 
Andalusia, Spain 18 (0.9) 


Eng/Afr/Zulu - RSA (5) S 6 (0.7) 


528 (2.0) 
512 (3.4) 
561 (3.8) 
531 (3.0) 
567 (2.6) 
445 (6.3) 
625 (2.6) 
518 (4.6) 
565 (4.0) 
548 (3.0) 
503 (13.8) 


Home computer/tablet or Internet connection 


(students): 
1) None 


2) Computer/tablet or Internet connection 


Number of digital information devices in 


the home (parents): 
1) None 
2) 1-3 devices 


3) 4-6 devices 
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Exhibit 4.2: Digital Devices in the Home (Continued) 


Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement 


46 (1.2) 
55 (1.1 
68 (1.0 
70 (0.5 
72 (0.8 
73 (1.0) 
75 (0.9) 
76 (1.3) 
80 (0.8) 
80 (0.9) 
70 (1.6) 


) 
) 
) 
) 


Digital device for reading (parents): 
1) None 
2) Either for the parent or for the child 


548 (3.1) 
524 (2.0) 
427 (7.7) 


24 (1.8 


0 (0.1) 
0 (0.0) 
0 (0.1) 
0 (0.1) 
0 (0.1) 
1 (0.1) 
0 (0.1) 
1 (0.2 
0 (0.2 
2 (0.3 


Average 


Scale Score 


11.7 (0.04) 
11.4 (0.03) 
10.8 (0.04) 
10.8 (0.02) 
10.5 (0.04) 
10.5 (0.04) 
10.8 (0.03) 
10.2 (0.06) 
10.2 (0.04) 
10.0 (0.04) 
8.0 (0.12) 


TIMSS & PIRLS 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 4.3: Students Speak the Language of the Test at Home 
Because learning to read is dependent on children’s early language experience, the language or 
languages spoken at home can be important influences in reading literacy development. Exhibit 
4.3 shows, on average, that 63 percent of the students reported “always” speaking the language 
of the test at home and most of the rest (31%) speaking it “almost always” or “sometimes.” There 
was relatively small variation in average achievement across these categories (511, 520, and 504, 
respectively), probably because of the many different interactions between the different languages 
which are spoken in homes and the various policies for the language(s) spoken in school, described 


in the PIRLS 2016 Encyclopedia. However, the few students (5% on average) who “never” spoke the 
language of the test at home had much lower average reading achievement (433). 
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Exhibit 4.3: Students Speak the Language of the Test at Home 


Students’ Reports 


Country 


Australia 

Austria 
Azerbaijan 
Bahrain 

Belgium (Flemish) 
Belgium (French) 
Bulgaria 

Canada 

Chile 

Chinese Taipei 
Czech Republic 
Denmark 

Egypt 

England 

Finland 

France 

Georgia 

Germany 

Hong Kong SAR 
Hungary 

Iran, Islamic Rep. of 
Ireland 

Israel 

Italy 

Kazakhstan 
Kuwait 

Latvia 

Lithuania 

Macao SAR 

Malta 

Morocco 
Netherlands 

New Zealand 
Northern Ireland 
Norway (5) 

Oman 

Poland 

Portugal 

Qatar 

Russian Federation 
Saudi Arabia 
Singapore 

Slovak Republic 
Slovenia 

South Africa 
Spain 

Sweden 

Trinidad and Tobago 
United Arab Emirates 
United States 


Percent 
of Students 
72 (1.0) 
69 (1.4) 
76 (1.4) 
52 (1.0 
66 (1.2 
61 (1.2 
75 (2.1 
60 (1.1 
78 (0.8 
39 (0.9 
77 (0.7 
69 (1.1 
57 (3.0 
73 (1.1 
71 (1.2 
71 (1.1 
75 (1.2) 
67 (1.4) 
54 (1.4 
82 (0.8 
59 (2.5 
79 (1.2 
69 (1.3 
70 (1.1 
78 (1.2 
13 (0.9) 
67 (1.3) 
70 (1.2) 
54 (0.7) 
) 
) 
) 


49 (0.9 
12 (0.9 
66 (1.1 


85 (0.9) 
68 (1.2) 
59 (1.6) 
81 (1.0) 
83 (0.8) 
37 (0.8) 
79 (1.0) 
27 (1.6) 
30 (0.6) 
69 (1.3) 
74 (1.6) 
66 (1.3) 
57 (1.3) 
a (1.4) 

81 (1.3) 
39 (0.8) 
72 (1.3) 


Almost Always Sometimes Never 5 

Average Percent Average Percent Average Percent Average 2 
Achievement of Students Achievement of Students Achievement of Students Achievement [RQ 

546 (2.6) 13 (0.6) 557 (4.4) 14 (0.7) 532 (5.1) 1 (0.1) ~~ 2 

553 (1.7) 13 (0.8) 536 (4.8) 16 (0.9) 501 (5.3) 3 (0.2) 495 (9.6) c 

472 (4.0) 12 (0.8) 473 (9.0) 11 (0.8) 490 (5.1) 1 (0.2) ~~ g 

437 (2.7) 13 (0.5) 467 (5.7) 29 (0.8) 467 (4.1) 5 (0.4) 407 (9.5) 2 

536 (1.8) 10 (0.5) 524 (3.6) 19 (0.8) 500 (3.2) 4 (0.4) 486 (7.3) 8 

504 (2.4) 17 (0.8) 504 (4.0) 20 (0.9) 478 (4.1) 2 (0.2) ~~ 5s 

567 (3.5) 8 (0.6) 556 (6.0) 11 (1.3) 508 (8.6) 6 (1.2) 445 (14.8) 8 

542 (2.1) 18 (0.6) 559 (2.5) 19 (0.8) 539 (2.4) 3 (0.3) 518 (8.5) € 

498 (2.5) 9 (0.4) 515 (5.8) 7 (0.4) 491 (5.4) 6 (0.5) 441 (6.6) z 

555 (2.7) 20 (0.7) 574 (3.1) 40 (0.9) 557 (2.2) 1 (0.2) ~~ ¥ 

542 (2.2) 16 (0.7) 556 (3.4) 7 (0.4) 531 (3.7) 1 (0.1) ~~ > 

553 (2.1) 20 (0.8) 547 (4.0) 10 (0.8) 521 (6.3) 1 (0.2) ~~ a 

328 (7.7) 11 (1.4) 346 (9.8) 16 (2.2) 354 (10.5) 16 (2.2) 317(116) 

559 (2.1) 11 (0.6) 575 (3.4) 14 (0.8) 555 (3.6) 2 (0.2) ~~ u 

570 (1.8) 19 (0.8) 568 (3.2) 9 (0.9) 541 (5.1) 1 (0.2) ~~ rs 

514 (2.4) 13 (0.7) 520 (4.1 15 (0.7) 494 (3.6) 1 (0.2 ~~ at 

490 (2.9) 9 (0.5) 511 (5.9) 14 (1.0) 484 (5.3) 2 (0.6) ~~ 

552 (2.6) 16 (1.0) 536 (7.3 15 (0.9) 510 (4.8) 1 (0.2) ~~ 

566 (2.9) 14 (0.7) 577 (4.4 28 (1.2) 573 (4.4) 4 (0.4 554 (8.8) 

556 (2.8) 15 (0.8) 554 (5.2 2 (0.4) ~~ 0 (0.1 ~~ 

448 (3.9) 8 (0.7) 435 (9.4) 14 (0.9) 436 (9.0) 19 (2.1 360 (9.9) 

567 (2.4) 10 (0.7) 587 (5.1 10 (0.8) 559 (5.5) 2 (0.3 ~~ 

527 (2.7) 13 (0.6) 553 (4.9 16 (0.9) 539 (3.9) 2 (0.3 ~~ 

554 (2.4) 14 (0.8) 552 (3.7 14 (0.8) 523 (3.6) 2 (0.4 ~~ 

537 (2.5) 8 (0.5) 546 (4.6 13 (0.9) 530 (4.5) 1 (0.2 ~~ 

374 (9.0) 24 (1.3) 393 (5.2) 33 (1.4) 420 (5.7) 30 (2.0) 384 (5.3) 

560 (2.1) 20 (1.0) 562 (2.8) 11 (0.8) 543 (3.7) 2 (0.3) ~~ 

549 (2.6) 19 (0.8) 562 (3.8) 10 (0.8) 526 (6.0) 1 (0.2) ~~ 

550 (1.4) 15 (0.5) 561 (3.3) 29 (0.7) 535 (2.2) 2 (0.2) ~~ 

459 (2.3) 20 (0.7) 463 (3.6) 26 (0.7) 451 (3.4) 5 (0.4) 378 (7.3) 

338 (6.9) 15 (1.1) 369 (9.2) 26 (1.1) 392 (4.7) 47 (1.8) 340 (4.3) 

549 (2.0) 16 an 8) 549 (3.4) 15 (0.9) 527 (3.9) 3 (0.6) 527 (10.8) 

565 (2.3) 9 90 7) 578 (5.5) 5 (0.5) 555 (7.6) 1 (0.2) ~~ 

563 (2.5) 21 (1.0) 557 (3.2) 10 (0.7) 542 (4.5) 1 (0.2) ~~ 

420 (3.6) 16 (0.9) 419 (5.1) 18 (0.7) 438 (4.6) 8 (0.6) 392 (7.5) 

560 (2.2) 16 (0.9) 588 (3.5) 3 (0.4) 573 (7.0) 0 (0.1) ~~ 

528 (2.5) 9 (0.5) 538 (4.1) 8 (0.5) 512 (3.8) 1 (0.2) ~~ 

423 (2.5) 15 (0.4) 455 (3.3) 38 (0.7 470 (2.5) 10 (0.5) 408 (5.2) 

583 (2.3) 11 (0.7) 584 (4.4) 8 (0.8 569 (7.0) 1 (0.3) ~~ 

408 (5.2) 22 (1.4) 452 (5.4) 24 (1.2) 454 (5.9) 28 (1.6) 438 (7.4) 

585 (3.4) 22 (0.6) 599 (3.2) 45 (0.7) 564 (3.7) 3 (0.2) 508 (9.0) 

543 (2.8) 17 (0.7) 554 (3.3) 11 (1.1) 494 (10.6) 2 (0.6) ~~ 

547 (2.0) 14 (0.7) 552 (4.1) 10 (0.8 508 (4.5) 3 (0.7) 487 (10.4) 

314 (4.1) 9 (0.4) 313 (8.0) 19 (0.9 363 (7.5) 6 (0.4) 308 (8.1) 

531 (1.4) 13 (0.6) 542 (3.0) 20 (0.8 523 (3.8) 10 (0.8) 502 (4.3) 

562 (2.5) 18 (0.9) 550 (3.6) 13 (0.9) 531 (6.0) 1 (0.1) ~~ 

479 (3.2) 8 (0.7) 498 (9.6) 9 (0.9) 486 (6.9) 2 (0.3) ~~ 

431 (3.4) 16 (0.6) 482 (4.2) 37 (0.7) 479 (4.4) 8 (0.5) 405 (6.4) 

555 (2.8) 11 (0.7) 553 (4.9) 16 (1.2) 529 (6.2) 1 (0.2) ~~ 


International Avg. 63 (0.2) Ban (0) 14 (0.1) 520 (0.7) VA(\m)) 504 (0.8) 5 (0.1) 433 (1.9) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


A dash (-) indicates comparable data not available. A tilde ( 
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541 (3.7 
548 (3.5 
508 (3.2 
521 (1.9 
613 (2.1 
400 (5.8 
524 (2.1 
548 (2.2 
390 (5.7 
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) 
) 
) 
) 
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511 (2.8) 
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563 (3.9) 
557 (3.9) 
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521 (3.5) 
617 (3.9) 


414 (11.8) 


545 (3.6) 
561 (2.6) 
449 (7.3) 
532 (2.6) 


Exhibit 4.3: Students Speak the Language of the Test at Home (Continued) 


12 (0.6 
21 (13 
21 (1.6 
11 (0.9 
13 (0.8 
6 (0.4 
34 (2.0) 
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35 (1.0) 
44 (0.8) 


) 
) 
) 
) 
) 
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489 (5.1 
540 (4.3 
535 (4.4 
471 (6.4 
499 (4.3 
591 (5.7 
427 (8.2 
521 (4.4 
547 (3.6 
452 (7.2 
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) 
) 
) 
) 
) 
) 
) 
) 
) 
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Percent Average Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement of Students Achievement 


510 (10.8) 
550 (7.6) 


357 (9.0) 
467 (9.9) 
386 (8.9) 
459 (6.0) 
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Exhibit 4.4: Parents Like Reading 


Young students who see adults and older children reading or using texts in different ways are 
learning to appreciate and use materials. Exhibit 4.4 presents the PIRLS 2016 Parents Like Reading 
scale. As described in the exhibit, students’ parents were asked a series of questions about their 
reading enjoyment and students were scored according to their parents’ responses. Exhibit 4.4 shows 
students’ average reading achievement in relation to how much their parents like to read. Across 
the PIRLS 2016 countries, the students whose parents Very Much Like to read (32%) had higher 
average achievement than the 51 percent of the students whose parents only like to read Somewhat 
(535 vs. 508). In turn, the students with parents who Do Not Like to read (17%) had the lowest 
achievement (488). 

Compared to PIRLS 2011, parental attitudes toward reading in 2016 were less positive on 
average in 31 countries, and more positive in only 2 countries. 
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Exhibit 4.4: Parents Like Reading 2016 ED srade 


Students Categorized by Parents’ Reports 

Students were scored on the Parents Like Reading scale according to their parents’ responses to eight statements about reading as 
well as how often they read for enjoyment. Students whose parents Very Much Like reading had a score on the scale of at least 
10.5, which corresponds to their parents “agreeing a lot” with four of the eight statements and “agreeing a little” with the other 
four, as well as reading for enjoyment “every day or almost every day,” on average. Students whose parents Do Not Like reading 
had a score no higher than 8.1, which corresponds to their parents “disagreeing a little” with four of the eight statements and 
“agreeing a little” with the other four, as well as reading for enjoyment only “once or twice a month,” on average. All other 
students had parents who Somewhat Like reading. 


Difference in 


Average 


Average Scale Score 


Scale Score 
from 2011 


Very Much Like Somewhat Like Do Not Like 
Country Percent Average Percent Average Percent Average 
of sates vila of Students | Achievement | of Students | Achievement 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Ireland 13 (0.7) 544 (5.2) 10.3 (0.05) -0.4 (0.07) @ 
Netherlands S a ae 7 16 (0.9) 525 (4.3) 10.0 (0.05) s -0.4 (0.08) @ 
Malta 45 (0.8 471 (2.3 1 % - ' 13 (0.5) 439 (3.9) 10.2 (0.03) -0.4 (0.05) @ 
Denmark 44 (1.1 564 (2.3 38 (1.0 542 (2.7) 17 (0.7) 530 (3.6) 10.1 (0.05) -0.6 (0.06) @ 
Sweden 44 (1.1 576 (2.9 42 (1.1 551 (3.0 13 (0.8) 529 (4.4) 10.1 (0.05) -0.8 (0.07) @ 
Azerbaijan 44 (1.3 481 (5.1 46 (1.1 470 (4.4 10 (0.9) 453 (6.8) 10.4 (0.06) 0.7 (0.08) © 
Norway (5) 42 (1.0 574 (2.6 44 (0.9 556 (2.5) 15 (0.9) 532 (3.9) 10.1 (0.05) me 
Trinidad and Tobago 41 (1.0 499 (3.6 49 (0.9 478 (4.3) 10 (0.6) 468 (6.1) 10.2 (0.04) -0.5 (0.06) @ 
Finland 41 (1.0 585 (2.2 43 (0.9 563 (2.5 16 (0.7) 542 (3.4) 10.0 (0.05) -0.5 (0.07) @ 
Spain 41 (0.8 545 (2.1 43 (0.7 524 (2.3 16 (0.7) 512 (2.5) 10.0 (0.04) 0.0 (0.05 
Israel 40 (1.1 554 (3.1 47 (0.9 522 (3.2) 13 (0.6) 519 (6.4) 10.0 (0.04) r -0.5 (0.06) @ 
Austria ( 564 (2.3 42 (0.8 534 (2.7) 18 (0.8) 516 (3.7) 9.9 (0.05) -0.4 (0.08) @ 
Canada r (0.8) 566 (2.1) 46 (0.7 540 (2.5 15 (0.5) 531 (3.3) 0.0 (0.03) r -0.5 (0.05) @ 
Bulgaria ( 587 (3.1 43 (14 548 (4.2. 19 (1.7) 493 (9.1) 9.8 (0.09) -0.2 (0.13 
Hungary ( 583 (3.0 45 (1.2 547 (3.3) 17 (1.0) 516 (4.6) 9.8 (0.06) -0.1 (0.08 
Czech Republic ( 565 (2.4 45 (0.7 540 (2.2) 18 (0.8) 514 (4.2) 9.8 (0.05) -0.2 (0.06) @ 
Italy ( 566 (2.5 47 (0.9 546 (2.7 16 (0.8) 530 (3.8) 9.9 (0.04) 0.1 (0.06 
Germany r (1.1) 578 (2.7) 44 (0.9 540 (3.3 20 (0.9) 509 (5.0) 9.7 (0.05) +r -0.4 (0.08) @ 
Poland ( 581 (2.9 50 (0.8 561 (2.3) 14 (0.8) 540 (4.3) 9.9 (0.04) oe 
Slovak Republic ( 566 (2.6 46 (1.0 532 (3.2) 19 (1.0) 489 (9.5) 9.6 (0.06) -0.3 (0.08) @ 
Portugal ( 546 (3.0 50 (0.9 522 (2.4 15 (0.7) 510 (5.4) 9.8 (0.04) 0.2 (0.05) © 
Georgia ( 512 (2.9 60 (1.1 482 (2.9 8 (0.8) 460 (11.3) 9.9 (0.04) -0.2 (0.06) @ 
Belgium (French) ( 526 (2.8 48 (0.9 495 (3.2) 23 (0.8) 473 (3.6) 9.4 (0.04) -0.4 (0.07) @ 
Belgium (Flemish) 28 (0.8 546 (2.0 48 (0.8 527 (2.1) 24 (0.7) 509 (2.9) 9.3 (0.04) me 
Lithuania ( 572 (3.2 48 (1.3 546 (3.5 25 (1.1) 530 (3.9) 9.3 (0.04) -0.3 (0.06) @ 
Slovenia ( 571 (3.0 58 (1.1 539 (2.2 16 (0.7) 517 (3.6) 9.5 (0.03) -0.3 (0.05) @ 
Bahrain ( 471 (3.2 60 (0.9 444 (2.9) 14 (0.6) 417 (4.3) 9.6 (0.02) ae 
Kazakhstan ( 545 (3.2 67 (1.1 533 (2.9) 7 (0.5) 531 (4.7) 9.9 (0.04) as 
Latvia ( 579 (2.6 52 (0.9 557 (2.2 22 (0.8) 541 (3.3) 9.4 (0.04) oe 
Kuwait ( 425 (6.1 57 (1.0 395 (4.5 18 (0.8) 378 (7.5) 9.5 (0.04) ee 
Russian Federation ( 602 (2.5 56 (0.8 578 (2.3) 20 (0.7) 560 (3.6) 9.4 (0.03) -0.2 (0.05) @ 
Singapore ( 603 (3.3 57 (0.7 572 (3.2) 18 (0.6) 561 (4.0) 9.4 (0.02) -0.3 (0.03) @ 
Iran, Islamic Rep. of ( 459 (4.9 62 (1.1 429 (3.5 14 (1.0) 374 (11.2) 9.5 (0.05) -0.3 (0.06) @ 
South Africa S (0.7) 359 (7.0) 63 (1.1 322 (5.3 13 (0.9) 307 (7.0) 9.7 (0.03) s -0.2 (0.05) @ 
Qatar ( 489 (3.3 62 (0.8 441 (2.0) 14 (0.4) 428 (4.3) 9.5 (0.02) -0.2 (0.05) @ 
France ( 539 (3.2 56 (0.8 513 (2.2) 21 (0.9) 491 (4.0) 9.3 (0.04) -0.2 (0.06) @ 
United Arab Emirates ( 496 (3.6 65 (0.5 445 (3.4 13 (0.4) 436 (4.5) 9.5 (0.02) -0.1 (0.03) @ 
Morocco ( 397 (4.3 47 (1.5 365 (4.4 31 (1.8) 330 (6.0) 9.0 (0.06) -0.3 (0.10) @ 
Chile ( 529 (3.3 52 (0.9 491 (2.8) 27 (0.9) 480 (3.7) 9.2 (0.04) a 
Oman ( 450 (4.7 67 (0.6 418 (3.3) 12 (0.5) 380 (5.3) 9.5 (0.02) 0.0 (0.03 
Saudi Arabia ( 454 (4.7 62 (1.0 428 (4.8 17 (0.8) 414 (6.2) 9.4 (0.04) -0.2 (0.06) @ 
Chinese Taipei ( 584 (2.9 61 (0.7 556 (2.5 20 (0.8) 548 (2.8) 9.2 (0.03) -0.2 (0.05) @ 
Hong Kong SAR ( 580 (3.1 61 (0.9 569 (3.2) 22 (0.8) 562 (3.5) 9.1 (0.03) -0.2 (0.04 
Macao SAR ( 563 (2.4) 62 (0.8 544 (1.4) 22 (0.6) 538 (2.7) 9.1 (0.02) mS 
Egypt ( 385 (8.1 54 (1.6 345 (5.0 33 (1.8) 286 (8.4) 87 (0.07) _ 
England -- -- -- -- -- -- -- -- 
United States 5 “S aes = ei ial 24 ao 
Northern Ireland X a (1.5 602 (3.9 36 (1.5 577 (5.1) 15 (1.0) 568 (6.0) 10.3 (0.07) x -0.4 (0.08) @ 
Australia X48 (1.4 582 (3.5 a ; : 551 (3.6) 12 (0.9) 535 (5.3) 10.3 (0.06) x -0.4 (0.09) @ 
New Zeohi0G xX 47 (1, 7 567 e 524 ee 13 . 7) 511 e 2) 10.3 (0.06) x -0.6 (0.07) @ 
This PIRLS questionnaire scale was established in 2011 based on the combined response distribution of all countries that Significantly higher than 2011 O 
participated in PIRLS 2011. To provide a point of reference for country comparisons, the scale centerpoint of 10 was located at Significantly lower than 2011 @ 


the mean of the combined distribution. The units of the scale were chosen so that 2 scale score points corresponded to the 
standard deviation of the distribution. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A dash (-) indicates comparable data not available. A tilde (~) indicates insufficient data to report achievement. 
An “r indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are available for at least 50% but less than 70% of the students. 


An “x” indicates data are available for less than 50% of the students—interpret with caution. TIMSS & PIRLS 
SZ International Study Center 
ww I Lynch School of Education 
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Benchmarking Participants 


48 (1.2 
Ontario, Canada 7 ea 
42 (1.2 
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Quebec, Canada 3113 
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Very Much Like 


Exhibit 4.4: Parents Like Reading (Continued) 


562 (2.3 
567 (3.8 
518 (3.4 
543 (1.9 
536 (2.5 
626 (2.5 
515 (3.6 
564 (3.3 
446 (7.5 
552 (2.7 
461 (6.7 


Somewhat Like 


544 (2.0) 
540 (3.7) 
497 (3.2) 
524 (2.7) 
513 (2.2) 
606 (2.4) 
475 (3.9) 
547 (3.5) 


) 
508 (2.4) 
414 (4.3) 


12 (0.6) 
13 (0.8) 
17 (0.7) 
17 (1.0) 
15 (0.6) 
10 (0.6) 
15 (0.8) 
17 (1.0) 
12 (0.6) 
12 (0.6) 
13 (0.7) 


534 (4.5) 
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480 (4.2) 
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489 (3.5) 
586 (4.0) 
474 (5.7) 
536 (3.7) 
401 (9.9) 
497 (3.5) 
400 (7.0) 


Please indicate how much you agree with the following statements about reading. 


1) read only if | have to* 
2) | like talking about what | read with other people 


3) I like to spend my spare time reading 


4) | read only if | need information* 


5 
6 
7) lenjoy reading 
8 


) 
) 
) 
) 


When youare at home, how often do you 


read for your enjoyment? 


*reverse coded 
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Reading is an important activity in my home 


| would like to have more time for reading 


Reading is one of my favorite hobbies 


Agree alot 


Very 
Much 
Like 


Every day 
or almost 
every day 


Agree a little 


Somewhat 
Like 


Once or 
twicea 
week 


Disagree 


alittle 


Once or 
twicea 
month 


Difference in 
Average Scale Score 
from 2011 


Average 
Scale Score 


10.4 (0.05) oe 

10.1 (0.06) r -0.5 (0.08) @ 
10.0 (0.05) Soe 

10.0 (0.05) 0.2 (0.07) 

9.9 (0.03) -0.6 (0.08) @ 
10.0 (0.04) Se 

9.9 (0.05) aie 

9.6 (0.06) -0.3 (0.08) @ 
9.8 (0.04) =e 

9.7 (0.02) -0.2 (0.03) @ 
9.4 (0.03) -0.1 (0.05) @ 


Significantly higher than 2011 © 
Significantly lower than 2011 @ 


Disagree 
alot 


Never or 
almost 
never 


é—3—3—_ 


Somewhat 


I 


8.1 


g 


‘ 
.\ 


Do Not 
Like 


TIMSS & PIRLS 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 4.5: Early Literacy Activities Before Beginning Primary School 
PIRLS has included an Early Literacy Activities scale in each assessment, and the results consistently 
show a strong relationship with achievement. Exhibit 4.5 shows that 39 percent of the students 
had parents who Often engaged them in early literacy activities and an additional 58 percent had 
parents who Sometimes engaged them in early literacy activities, with the students in the Often 
category having higher average achievement (529 vs. 505, respectively). In several countries, a small 
percentage of students (3% on average) had parents who Never or Almost Never engaged them 
in early literacy activities and these students typically had low average reading achievement (419). 
As some good news, PIRLS shows a trend toward more parental involvement in their children’s 


literacy development. In 16 countries, there was an increase between PIRLS 2011 and 2016 in the 
time spent on early literacy activities and only 1 country had a decrease. 
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Exhibit 4.5: Early Literacy Activities Before Beginning Primary School 


Students Categorized by Parents' Reports 


Students were scored according to their parents’ frequency of doing the nine activities on the Early Literacy Activities scale. 
Students Often engaged in early literacy activities had a score on the scale of at least 10.7, which corresponds to their parents 
“often” doing five of the nine activities with them and “sometimes” doing the other four, on average. Students Never or Almost 
Never engaged in such activities had a score no higher than 6.2, which corresponds to parents “never or almost never” doing five 
of the nine activities with them and “sometimes” doing the other four, on average. All other students had parents who Sometimes 


engaged them in early literacy activities. 
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564 (2.8) 
575 (2.9) 
341 (7.8 
583 (2.5 
488 (3.7) 
476 (3.2) 
601 (2.9 
515 (3.0 
483 (2.7) 
490 (4.8) 
424 (5.7 
543 (2.8 
454 (4.4) 
453 (4.3) 
384 (6.2 
451 (5.7 
586 (2.8) 
580 (3.6) 
385 (7.0 
560 (3.7 


597 (3.9 
560 (3.1 
572 a 7 


a A) 
42 (1.0) 
ua a! 


569 a 
531 (3.0) 
482 (3.5) 
554 (2.9) 
467 (4.0) 
529 (3.7) 
558 (2.5) 
445 (2.3) 
525 (3.2) 
519 (2.0) 
539 (2.3) 
552 (2.1) 
544 (2.9) 
532 (2.6) 
539 (2.3) 
483 (2.9) 
545 (4.6) 
553 (2.8) 
547 (2.6) 
544 (3.0) 
539 (4.0) 
552 (2.6) 
534 (2.4) 
510 (2.4) 
521 (2.5) 
542 (2.3) 
552 (2.7) 
327 (5.0) 
562 (1.9) 
442 (3.3) 
436 (2.5) 
569 (3.3) 
493 (3.0) 
439 (2.1) 
468 (4.6) 
391 (4.6) 
524 (1.9) 
426 (4.5) 
413 (3.5) 
331 (5.3) 
430 (3.5) 
556 (2.1) 
568 (3.0) 
371 (3.9) 
545 (1.2) 


571 (4.0) 
521 (3.3) 
553 a 3) 


Never or Almost Never 


Ea Average Baresi Average Percent Average 
oe aera we Achievement ae Achievement 


=) 


c a a 

0.4) ~~ 

0.2) ae 

1 (0.2) ~~ 

1 (0.5) a 

0.2) ~~ 

0.1) a 
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1 (0.1) a 

1 (0.2) ~~ 

(0.1) oe 

0.2) ~~ 

0.2) a 

1 (0.1) ~~ 

1 (0.2) re 

13) 453 (14.6) 

0.6) a 
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0.3) ae 
(0.2) ~~ 

1 (0.2) a 
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0.2) ~~ 

0.2) a 
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This PIRLS questionnaire scale was established in 2011 based on the combined response distribution of all countries that 


participated in PIRLS 2011. To provide a point of reference for country comparisons, the scale centerpoint of 10 was located at 


the mean of the combined distribution. The units of the scale were chosen so that 2 scale score points corresponded to the 
standard deviation of the distribution. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


A dash (-) indicates comparable data not available. A tilde (~) indicates insufficient data to report achievement. 
An “r” indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are available for at least 50% but less than 70% of the students. An “x” 


indicates data are available for less than 50% of the students—interpret with caution. 
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Average 
Scale Score 


11.3 (0.04 
11.2 (0.06) 
10.8 (0.06) 
10.9 (0.04 
10.8 (0.05 
10.6 (0.05) 
10.7 (0.03) 
10.7 (0.03 
10.7 (0.05 
10.6 (0.03) 
10.7 (0.04) 
10.7 (0.03 
10.6 (0.04 
10.6 (0.04) 
10.5 (0.03) 
10.4 (0.04 
10.0 (0.10 
10.3 (0.05) 
10.3 (0.04) 
10.3 (0.04 
10.2 (0.04 
10.1 (0.03) 
10.1 (0.03) 
10.1 (0.04 
10.1 (0.04 
10.0 (0.04) 
10.0 (0.03) 
9.9 (0.08 
9.9 (0.03 
9.8 (0.03) 
9.9 (0.02) 
9.7 (0.03 
9.7 (0.04) 
9.7 (0.02) 
9.5 (0.07) 
9.6 (0.03 
9.5 (0.03 
9.5 (0.04) 
9.5 (0.03) 
8.7 (0.13 
9.1 (0.08 
9.0 (0.04) 
8.9 (0.04) 
7.7 (0.09 
8.5 (0.03 


11.5 (0.06 
11.1 (0.05 
11.0 (0.07) 


Difference in 
Average Scale Score 


from 2011 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 4.5: Early Literacy Activities Before Beginning Primary School 
(Continued) 


verage 
Country Percent Average Percent Average Percent Average aanGern Average Scale Score 
of Students | Achievement | of Students | Achievement | of Students | Achievement from 2011 


Benchmarking Participants 


Moscow City, Russian Fed. 71 (0.8) 617 (2.1) 28 (0.8) 600 (2.8) 0 (0.1) cain 11.6 (0.04) ee 
Madrid, Spain 57 (0.9) 559 (2.0) 43 (0.9) 541 (2.7) 0 (0.1) ae 10.9 (0.03) Ss 
Ontario, Canada r 55 (1.4) 561 (3.4) 44 (1.3) 538 (3.7) 1 (0.3) es 10.9 (0.06) r 0.0 (0.08) 
Andalusia, Spain 52 (1.2) 539 (2.1) 47 (1.1) 517 (2.4) 1 (0.2) oe 10.7 (0.05) 0.4 (0.06) 
Buenos Aires, Argentina s 50 (1.2) 506 (3.5) 49 (1.2) 471 (3.9) 1 (0.2) ~~ 10.7 (0.05) a 
Quebec, Canada 41 (1.2) 563 (3.3) 58 (1.3) 543 (3.0) 1 (0.4) oo o> 10.2 (0.04) 0.0 (0.06) 
Dubai, UAE 36 (1.0) 548 (2.7) 62 (0.9) 504 (2.2) 1 (0.1) ae 10.1 (0.03) 0.1 (0.04) © 
Norway (4) 36 (0.8) 535 (2.3) 63 (0.9) 509 (2.2) 1 (0.2) rat tes 10.1 (0.03) 0.1 (0.06) 
Denmark (3) 35 (0.9) 518 (3.5) 64 (0.9) 495 (2.9) 1 (0.2) cd 10.0 (0.04) ae 
Eng/Afr/Zulu - RSA (5) Ss 34 (1.3) 440 (8.1) 63 (1.3) 407 (7.3) 3 (0.3) 405 (21.2) 9.9 (0.06) Bs 
Abu Dhabi, UAE 29 (0.9) 452 (5.5) 69 (0.9) 411 (4.7) 2 (0.3) mn 9.7 (0.04) 0.2 (0.06) 


cP) 
SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 


(4) 
Significantly higher than 2011 © 
Significantly lower than 2011 @® 


Before your child began primary/elementary school, how often did you or someone else in your 
home do the following activities with him or her? 
Often Sometimes Never or 
almost never 


1) Read books 

2) Tell stories 

3) Sing songs 

4) Play with alphabet toys (e.g., blocks with letters of the alphabet) 
5) Talk about things you had done 

6) Talk about what you had read 

7) Play word games 

8) Write letters or words 


9) Read aloud signs and labels 


SSE 


Never 
Often | Sometimes | or Almost 


Never 
2 


10.7 
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Exhibit 4.6 and 4.7: Attended Preprimary Education 


There was a positive relationship for fourth grade students between the number of years students 
attended preprimary education and their reading achievement. According to their parents, across 
countries a majority of the PIRLS 2016 students had attended 3 years or more of preprimary 
school—59 percent. Beyond that, on average 18 percent had attended 2 years, 12 percent attended 
1 year or less, and only 11 percent had not attended preprimary school. The students who attended 
3 years or more had the highest average reading achievement (520), with those with less preprimary 
school attendance having successively lower average achievement (507, 498, and 472, respectively). 

Although there is considerable variation across countries, according to the PIRLS 2016 
Encyclopedia, some countries already have mandatory preprimary education (e.g., Denmark, Latvia, 
Macao, and Trinidad and Tobago), some have nearly 100 percent enrollment even though attendance 
is not mandatory (e.g., Ireland, Czech Republic, and France), and a number of the remaining 
countries are working to increase enrollment in preprimary education. Of course, school policies 
of entering primary school at older ages (e.g., age 7 in Finland, Lithuania, South Africa, and Sweden) 
permit opportunities for more years of preschool attendance than when children start primary 
school at younger ages (e.g., age 4 or 5 in Malta, England, and Northern Ireland). Exhibit 2 in About 
PIRLS contains information across countries about the different policies and practices about the 
age of entry to primary school. 

The results in Exhibit 4.7 indicate, however, that preprimary education cannot completely 
replace parental involvement in developing children’s reading literacy. At each level of preprimary 
attendance from 3 years or more down through 1 year or less, the students whose parents Often 
engaged them in early literacy activities had higher average reading achievement than those engaged 
only Sometimes or Never. 
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Exhibit 4.6: Students Attended Preprimary Education 


Students Categorized by Parents' Reports 


Students Attended Preprimary Education 


Country 
Percent of | Average Percent of | Average Percent of | Average Percent of | Average 
Students | Achievement] Students | Achievement] Students | Achievement] Students 


a 

3 
Denmark ( 552 (2.1) 3 (0.3 521 (9.0) 1( 1 (0.2) a 
Hungary 93 (0.8 558 (2.8) 4 (0.6 535 (8.0) 2 (0.2 ~~ 1 (0.3) ~~ 5 
Belgium (French) 93 (0.4 502 (2.6) 5 (0.4) 480 (6.1) 2 (0.3 ~~ 0 (0.0) ~e @ 
Sweden 91 (0.6 563 (2.3) 3 (0.3 542 (7.9) 3 (0.4 528 (7.4) 2 (0.3) ~~ § 
Belgium (Flemish) 89 (0.7 532 (1.7) 5 (0.5) 506 (6.8) 3 (0.3 508 (5.8) 3 (0.4) 488 (5.3) 7 
Italy 87 (0.8 555 (2.2) 8 (0.6 528 (5.4) 3 (0.4 531 (8.1) 3 (0.3) 530 (9.4) £ 
Netherlands Ss 84 (1.2 555 (2.2) 11 (1.0 538 (6.2) 3 (0.5 538 (9.5) 2 (0.4) ~~ £ 
Hong Kong SAR 84 (0.7 570 (2.8) 3 (0.3 574 (6.3) 7 (0.5 568 (5.7) 5 (0.5) 566 (5.7) g 
Israel 83 (0.9 549 (2.6) 10 (0.7 477 (5.6) 4 (0.4 477 (10.1) 3 (0.3) 456 (14.0) & 
Latvia 83 (0.9 562 (1.7) 10 (0.8 540 (4.5) 5 (0.4 541 (6.2) 1 (0.2) ~~ = 
Norway (5) 82 (0.9 565 (2.2) 5 (0.4 530 (6.6) 10 (0.7 549 (4.5) 3 (0.3) 537 (8.9) a 
Slovenia 81 (1.1 549 (2.1) 9 (0.7) 524 (6.5) 5 (0.4 525 (6.6) 5 (0.5) 512 (10.6) 
Singapore 81 (0.6 586 (2.9) 12 (0.4) 549 (5.0) 4 (0.2 541 (6.8) 4 (0.3) 521 (8.0) g 
France 80 (0.8 519 (2.5) 6 (0.5 509 (5.7) 6 (0.4 490 (5.1) 8 (0.5) 494 (5.6) 
Czech Republic 80 (1.0 549 (2.0) 13 (0.7) 542 (4.0) 5 (0.4 523 (8.8) 3 (0.5) 481 (16.6 
Austria 79 (1.1 548 (2.2) 14 (0.8) 533 (3.6) 5 (0.4 524 (6.2) 2 (0.3) ~~ 
Bulgaria 79 (1.7 564 (3.9) 8 (0.6 527 (8.8) 10 (1.1 511 (9.1) 3 (0.6) 489 (14.5 
Macao SAR 77 (0.7 547 (1.3) 7 (0.3 547 (4.4) 12 (0.5) 541 (2.9) 5 (0.3) 533 (5.2) 
Slovak Republic 76 (1.5 550 (2.4) 11 (0.8 517 (7.0) 9 (0.8 507 (8.4) 5 (1.0) 415 (27.8 
Russian Federation 75 (1.1 586 (1.9) 7 (0.5) 581 (4.6) 5 (0.3 573 (5.6) 13 (0.9) 553 (5.3) 
Portugal 23 (1.0 532 (2.5) 15 (0.8) 527 (3.8) 6 (0.5 525 (5.6) 5 (0.4) 503 (5.6) 
Lithuania 69 (1.3 558 (2.4) 7 (0.5) 546 (8.1) 16 (0.8 520 (5.5) 9 (0.7) 534 (8.5) 
Finland 68 (1.1 569 (1.9) 12 (0.6) 565 (3.7) 18 (1.0) 571 (3.4) 1 (0.2) ~~ 
Poland 65 (1.5) 572 (2.3) 19 (0.8) 556 (3.5) 16 (1.2) 546 (4.1) 0 (0.1) ~~ 
Germany tr 64 (1.1) 555 (2.7) 9 (0.6) 542 (5.5) 17 (0.9) 541 (6.3) 10 (0.7) 520 (6.4) 
Spain 60 (0.8) 538 (1.6) 17 (0.6) 528 (2.5) 13 (0.5) 519 (3.5) 10 (0.5) 513 (3.6) 
Georgia 56 (1.4) 496 (3.1) 20 (0.9) 492 (4.6) 9 (0.7) 488 (6.7) 16 (1.4) 468 (6.5) 
Chile $3 (1.3) 499 (2.9) 28 (0.9) 495 (3.4) 12 (0.7) 486 (5.7) 6 (0.6) 493 (7.0) 
Chinese Taipei 53 (1.0) 564 (2.2) 35 (0.8) 561 (2.4) 8 (0.5) 549 (5.1) 4 (0.3) 523 (7.1) 
South Africa s 47 (1.4) 337 (6.8) 16 (0.9) 337 (8.2) 22 (0.8) 319 (5.5) 15 (0.9) 311 (4.8) 
Canada r 43 (0.8) 558 (2.0) 25 (0.7) 550 (2.6) 15 (0.5) 542 (2.9) 16 (0.6) 534 (2.6) 
Kazakhstan 38 (1.7) 550 (3.1) 14 (0.8) $33 (3.2) 22 (1.5) 533 (3.9) 26 (1.6) $22 (3:7) 
Bahrain 32 (0.8) 455 (3.5) 32 (0.8) 451 (3.0) 17 (0.7) 451 (5.8) 20 (0.8) 431 (3.9) 
Ireland 31 (0.8) 578 (3.0) 40 (1.1) 573 (3.1) 24 (1.0) 565 (3.4) 4 (0.4) 543 (7.9) 
Egypt 31 (2.1) 359 (6.2) 26 (1.8) 355 (6.7) 10 (1.0) 312 (9.3) 33 (2.3) 290 (9.6) 
Malta 28 (0.8) 464 (3.5) 59 (0.8) 462 (2.1) 9 (0.5) 445 (4.9) 5 (0.4) 44) (7.0) 
Trinidad and Tobago tr 27 (1.0) 479 (4.6) 55 (1.2) 494 (3.6) 11 (0.9) 482 (7.8) 6 (0.5) 466 (8.4) 
Morocco 27 (1.2) 397 (3.4) 22 (1.1) 385 (4.8) 16 (0.9) 352 (5.3) 35 (1.7) 324 (6.5) 
Qatar r 25 (0.4) 461 (2.3) 33 (0.6) 464 (2.7) 22 (0.7) 459 (3.6) 20 (0.4) 413 (3.6) 
Kuwait r 20 (1.1) 409 (5.2) 39 (1.2) 396 (5.2) 18 (1.1) 412 (8.4) 22 (1.4) 390 (6.1) 
Azerbaijan 20 (1.2) 490 (5.0) 10 (0.7) 493 (5.7) 16 (0.8) 480 (6.3) 55 (1.8) 462 (5.5) 
United Arab Emirates 18 (0.4) 483 (4.2) 42 (1.0) 450 (3.5) 21 (0.7) 463 (4.3) 19 (0.9) 434 (4.0) 
Oman 14 (0.5) 443 (6.0) 31 (0.8) 44) (3.9) 28 (0.8) 420 (4.2) 28 (0.8) 385 (3.7) 
Iran, Islamic Rep. of 12 (0.7) 469 (5.9) 16 (0.8) 454 (5.8) 49 (1.6) 429 (4.5) (11) 387 (6.4) 
Saudi Arabia 6 (0.5) 453 (8.9) 15 (1.1) 454 (5.7) 35 (1.2) 434 (4.6) 45 (1.6) 422 (5.7) 
England -- -- -- -- -- -- -- -- 
Northern Ireland mie oa mos ae oe or == oar 
United States -- -- == -- -- -- -- -- 
New Zealand X 60 (1.3) 549 (2.9) 31 (1.1) 544 (3.3) 6 (0.7) 525 (7.7) 3 (0.4) 507 (13.7) 
Australia X a (1.2) 7 565 7 33 a 7 568 a " 22 oa 565 aaa 5 om 525 7: . 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A dash (-) indicates comparable data not available. A tilde (~) indicates insufficient data to report achievement. 


An “r" indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are available for at least 50% but less than 70% of 
the cfidents: An "x" indicates data are available for less than 50% of the students—interpret with caution. 


Z TIMSS & PIRLS 
International Study Center 163 

Zw l EA Lynch School of Education 

Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


Benchmarking Participants 


Moscow City, Russian Fed. 
Buenos Aires, Argentina 


Quebec, Canada 
Andalusia, Spain 
Eng/Afr/Zulu - RSA (5) 
Ontario, Canada 


Abu Dhabi, UAE 


Percent of 
Students 


96 (0.4) 
82 (0.7) 
78 (0.9) 
78 (1.1) 
67 (1.0) 
58 (1.3) 
56 (1.2) 
47 (1.8) 
39 (1.6) 
23 (0.6) 
17 (0.8) 
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Average 
Achievement} Students 


504 (2.7) 
522 (2.2) 
613 (2.2) 
499 (3.4) 
557 (2.0) 
557 (2.9) 
537 (2.2) 
436 (9.4) 
560 (4.3) 
539 (3.2) 
457 (7.5) 


Exhibit 4.6: Students Attended Preprimary Education (Continued) 


Students Attended Preprimary Education 


Percent of 


2 (0.3) 
4 (0.4) 
9 (0.5) 
12 (0.8) 
14 (0.5) 
14 (0.9 
19 (0.9 
18 (1.0 
28 (1.0 
38 (1.1 
43 (1.3 


Average 
Achievement 


499 (7.2) 
610 (4.2) 
467 (6.7) 
550 (3.1) 
545 (5.4 
528 (3.1 
423 (7.7 
553 (4.3 
519 (2.7 


) 
) 
) 
) 
) 
415 (5.1) 


Percent of 
Students 


1 (0.2) 
11 (0.6) 
6 (0.5) 
8 (0.5) 
10 (0.6) 
11 (0.7) 
16 (0.7) 
22 (1.3) 
13 (0.8) 
22 (0.7) 
21 (0.9) 


Average 
Achievement 


511 (4.1) 
608 (5.1) 
449 (6.5) 
539 (4.2) 
551 (7.0) 
514 (3.1) 
393 (7.8) 
543 (5.6) 
523 (3.1) 
422 (5.9) 


Percent of 
Students 


Average 


Achievement 


1 (0.1) ~~ 
3 (0.4) 497 (9.0) 
8 (0.5) 609 (5.8) 
2 (0.4) ~~ 
9 (0.6) 528 (4.1) 
17 (1.1) 534 (3.7) 
9 (0.6) 504 (5.6) 
13 (1.0) 378 (7.6) 
20 (1.3) 535 (3.7) 
17 (0.7) 490 (3.6) 
19 (1.1) 406 (5.5) 
ZF 
iF 
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Exhibit 4.7: Early Preparation for School 


Students Categorized by Parents' Reports 


Attended Preprimary Education Program Attended Preprimary Education Attended Preprimary Education Program 
for 3 Years or More Program for 2 Years for 1 Year or Less Including Did Not Attend 
Country 


Someti N Someti N Someti N 
Often Engaged in Early sas aie see Often Engaged in Early sale ey, ew Often Engaged in Early ies was sae 
Engaged in Early ; nae Engaged in Early Engaged in Early 
Literacy Activities 


Literacy Activities Literacy Activities 


Literacy Activities Literacy Activities Literacy Activities 


Percent Average Percent Average Percent Average Percent Average Percent Average Percent Average 
of Students} Achievement} of Students} Achievement} of Students} Achievement} of Students} Achievement} of Students} Achievement} of Students} Achievement 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Russian Federation 571 (7.7) 543 (6.3) 
Israel a i = oo a. = . a . a s. . a a : : a. 466 (6.3) - a oa . : - 454 (8.5) 
Italy 43 (1.1) 562 (2.2) 43 (1.0) 548 (3.0) : or] 533 (8.7) 4 _ 523 (6.0) 2 (0.3) ~~ 3 (0.4) 521 (8.7) 
Latvia 42 (0.9) 569 (2.0) 42 (1.0) 556 (2.3) 5 (0.5) 549 (5.1) 5 (0.5) 531 (6.4) 3 (0.3) 549 (9.8) 3 (0.4) 536 (7.0) 
Slovak Republic 40 (0.9) 556 (2.8) 36 (1.1) 543 (2.9) 5 (0.5) 531 (9.1) 6 (0.5) 504 (7.3) 6 (0.7) 508 (8.8) 7 (0.9) 448 (17.7) 
Slovenia 40 (1.1) 561 (2.4) 42 (1.1) 538 (2.9) 4 (0.4) 541 (7.0) 5 (0.5) 510 (9.1) 4 (0.3) 540 (7.5) 6 (0.5) 505 (7.7) 
Hungary 39 (0.9) 564 (3.6) 54 (1.1) 554 (2.8) 2 (0.4) ~~ 2 (0.4) ~~ 1 (0.2) ~~ 2 (0.3) ~~ 
Czech Republic 37 (0.9) 555 (2.2) 43 (0.9) 543 (2.4) 6 (0.4) 554 (5.4) 7 (0.6) 533 (6.3) 3 (0.3) 518 (11.4) 4 (0.4) 502 (12.2) 
Bulgaria 37 (1.3) 582 (3.1) 42 (1.3) 548 (5.2) 3 (0.3) 575 (7.2) 5 (0.5) 499 (11.3) 3 (0.4) 561 (10.7) 10 (1.4) 488 (11.1) 
Netherlands S$ 34(1.3) 563 (2.9) 50 (1.4) 550 (2.8) 5 (0.7) 549 (9.0) 6 (0.7) 531 (7.4) 2 (0.4) ~~ 3 (0.5) 524 (8.2) 
Denmark 34 (1.1) 565 (2.7) 61 (1.1) 544 (2.2) 1 (0.2) ~~ 2 (0.3) ~~ 1 (0.1) ~~ 1 (0.2) ~~ 
Georgia 34 (1.3) 499 (3.5) 21 (1.1) 492 (4.1) 11 (0.7) 501 (5.0) 9 (0.6) 481 (6.4) 11 (0.9) 484 (6.2) 14 (1.2) 468 (5.8) 
Poland 34 (1.1) 579 (2.6) 31 (1.2) 566 (3.0) 9 (0.5) 563 (5.2) 10 (0.6) 550 (5.5) 8 (0.7) 553 (5.3) 9 (0.8) 541 (6.3) 
Sweden 33 (0.9) 576 (2.8) 58 (0.9) 555 (2.5) 1 (0.2) ~~ 2 (0.3) ~~ 1 (0.2) ~~ 4 (0.4) 513 (6.2) 
Spain 32 (0.7) 548 (1.9) 28 (0.7) 525 (1.9) 8 (0.4) 538 (3.2) 9 (0.4) 518 (3.6) 10 (0.4) 529 (3.0) 13 (0.5) 506 (3.5) 
France 31 (1.2) 526 (3.7) AQ (1.2) 515. (2.5) 2 (0.3) ~~ 4 (0.3) 506 (7.3) 4 (0.4) 510 (5.9) 9 (0.5) 484 (4.6) 
Norway (5) 31 (0.7) 578 (2.7) 51 (0.9) 557 (2.6) 2 (0.3) ~~ 3 (0.3) 521 (7.8) 5 (0.4) 560 (6.0) 9 (0.6) 539 (4.6) 
Austria 31 (0.9) 560 (3.1) 48 (1.0) 540 (2.2) 5 (0.4) 553 (5.4) 9 (0.7) 521 (3.8) 2 (0.2) ~~ 5 (0.4) 511 (7.2) 
Portugal 30 (0.9) 546 (3.1) 44 (0.9) 522 (2.7) 5 (0.4) 536 (5.6) 10 (0.6) 522 (4.6) 3 (0.3) 530 (7.3) 8 (0.5) 511 (4.7) 
Lithuania 29 (0.9) 564 (2.7) 40 (1.2) 554 (2.9) 3 (0.3) 557 (10.9) 4 (0.4) 539 (10.7) 9 (0.7) 546 (7.8) 15 (0.9) 515 (4.7) 
Belgium (French) 28 (0.8) 518 (3.0) 65 (0.8) 495 (3.0) 1 (0.2) ~~ 4 (0.4) 477 (6.2) 1 (0.1) ~s 1 (0.2) ~~ 
Kazakhstan 28 (1.5) 552 (3.5) 11 (0.7) 544 (3.6) 9 (0.6) 533 (3.8) 5 (0.4) 534 (4.3) 28 (1.4) 529 (3.4) 20 (1.2) 524 (4.1) 
Germany r 26 (0.9) 568 (3.0) 38 (1.1) 546 (3.7) 3 (0.4) 556 (7.6) 5 (0.4) 533 (8.2) 10 (0.6) 545 (5.9) 18 (0.9) 527 (6.2) 
Chile 25:10) 516 (3.2) 28 (0.7) 486 (3.5) 13 (0.7) 512 (5.7) 16 (0.7) 483 (3.4) 7 (0.4) 507 (6.4) 11 (0.9) 478 (6.2) 
Singapore 25 (0.7) 607 (2.8) 56 (0.7) 577 (3.2) 3 (0.2) 574 (7.3) 9 (0.4) 541 (5.3) 1 (0.1) ~~ 6 (0.3) 523 (6.2) 
Finland 22 (0.9) 584 (2.4) 46 (0.9) 563 (2.2) 4 (0.3) 570 (6.2) 8 (0.5) 563 (4.5) 6 (0.4) 590 (5.6) 13 (0.8) 562 (4.0) 
Belgium (Flemish) 22 (0.6) 547 (2.9) 66 (0.8) 527 (1.7) 1 (0.2) ~~ 4 (0.4) 504 (7.0) 2 (0.2) ~~ 5 (0.3) 488 (5.4) 
Canada tr 22 (0.7) 567 (2.5) 21 (0.5) 548 (2.6) 14 (0.5) 562 (3.3) 12 (0.4) 536 (3.1) 14 (0.5) 550 (2.9) 18 (0.6) 527 (2.7) 
Ireland 19 (0.8) 592 (3.5) 13 (0.6) 558 (4.2) 22 (0.8) 587 (3.2) 18 (0.7) 556 (4.1) 14 (0.8) 577 (4.8) 15 (0.7) 547 (3.9) 
South Africa Ss 18(1.4) 350 (11.0)  30(1.1) 333 (6.4) 5 (0.4) 363 (14.5) 11 (0.9) 332 (8.5) 12 (0.6) 330 (6.6) 25 (1.1) 314 (4.3) 
Malta 15 (0.7) 482 (4.0) 13 (0.6) 441 (5.0) 30 (0.8) 472 (3.2) 29 (0.8) 451 (2.9) 6 (0.5) 457 (5.8) 7 (0.5) 434 (5.4) 
Trinidad and Tobago tr 14(0.7) 492 (6.0) 13 (0.7) 464 (5.6) 30 (1.2) 511 (4.1) 25 (0.9) 474 (4.3) 9 (0.6) 507 (7.6) 9 (0.7) 447 (8.3) 
Hong Kong SAR 12 (0.6) 581 (3.8) 73 (0.9) 568 (3.0) 0 (0.1) ~~ 3 (0.3) 575 (6.5) 1 (0.2) ~~ 11 (0.6) 566 (4.8) 
Bahrain 12 (0.5) 476 (5.2) 20 (0.6) 443 (3.9) 11 (0.4) 476 (5.0) 22 (0.7) 438 (3.7) 9 (0.5) 476 (5.5) 27 (0.9) 429 (4.5) 
Egypt 10 (1.3) 397 (6.9) 21 (1.5) 342 (6.3) 6 (0.7) 388 (8.2) 20 (1.4) 344 (7.2) 5 (0.5) 353 (9.9) 38 (2.2) 289 (9.0) 
Chinese Taipei 9 (0.6) 590 (3.3) 44 (0.9) 559 (2.3) 6 (0.4) 583 (4.3) 29 (0.9) 557 (2.5) 2 (0.3) ~~ 10 (0.6) 533 (4.5) 
Qatar r 8 (0.4) 495 (5.2) 16 (0.5) 445 (3.0) 11 (0.4) 492 (4.1) 23 (0.5) 452 (3.6) 10 (0.5) 468 (4.5) 32 (0.6) 427 (3.1) 
Azerbaijan 8 (0.7) 506 (6.4) 12 (0.8) 480 (5.4) 3 (0.4) 507 (6.4) 6 (0.5) 485 (7.3) 16 (0.8) 480 (6.6) 54 (1.6) 462 (5.2) 
Macao SAR 8 (0.4) 562 (4.6) 69 (0.7) 546 (1.4) 1 (0.1) ~~ 6 (0.4) 546 (5.4) 1 (0.2) ~~ 15 (0.6) 537 (2.5) 
Kuwait tr 6 (0.6) 428 (9.5) 13 (0.8) 401 (5.1) 11 (0.7) 427 (6.0) 28 (1.1) 385 (6.3) 10 (0.6) 426(11.1) 311.2) 392 (6.3) 
United Arab Emirates 6 (0.3) 512 (5.8) 11 (0.3) 468 (4.6) 13 (0.6) 483 (4.5) 29 (0.6) 434 (3.6) 12 (0.4) 482 (4.4) 29 (0.8) 437 (3.9) 
Morocco 5 (0.4) 414 (7.1) 22 (1.0) 394 (3.3) 3 (0.2) 408 (9.4) 19 (1.0) 382 (4.8) 3(0.5) 335°(11.3) | 48 (1,7) 333 (5.4) 
Oman 5 (0.2) 465 (8.0) 9 (0.4) 432 (7.0) 8 (0.4) 466 (5.1) 22 (0.7) 434 (4.4) 10 (0.5) 441 (5.1) 46 (1.0) 394 (3.7) 
Iran, Islamic Rep. of 4 (0.4) 477 (8.0) 9 (0.6) 465 (7.3) 4 (0.3) 466 (9.3) 12 (0.7) 451 (5.9) 12 (0.7) 440 (6.4) 59 (1.4) 412 (4.7) 
Saudi Arabia 2 (0.3) ~~ 4 (0.4) 440 (11.0) 5 (0.5) 465 (7.9) 10 (0.8) 447 (6.2) 17 (0.8) 450 (5.3) 62 (1.2) 421 (4.6) 
England -- -- -- -- -- -- -- -- -- -- -- -- 
Northern Ireland -- -- -- -- -- -- -- -- -- -- -- -- 
United States FS a= =e == a= eS == =e ee as =e == 
New Zealand x 35 (1.1) 565 (3.7) 25 (0.9) 528 (4.1) 18 (1.0) 560 (4.9) 13 (0.7) 521 (5.2) 4 (0.5) 547 (6.5) 5 (0.6) 497 (8.6) 
eee x 24 : “ 571 2 : 16 = : 556 : s e : = 575 = 0) 13 < = 558 2 - e - i 573 a : 14 - : 542 = : 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A dash (-) indicates comparable data not available. A tilde (~) indicates insufficient data to report achievement. 
An “r" indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are available for at least 50% but less than 70% of the students. 


ayn 


An “x" indicates data are available for less than 50% of the students—interpret with caution. 
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Exhibit 4.7: Early Preparation for School (Continued) 


Attended Preprimary Education Program Attended Preprimary Education Attended Preprimary Education Program 
for 3 Years or More Program for 2 Years for 1 Year or Less Including Did Not Attend 


Sometimes or Never 


Benchmarking Participants 


Moscow City, Russian Fed. 
Buenos Aires, Argentina 5 
Madrid, Spain 

Denmark (3) 

Andalusia, Spain 

Norway (4) 

Quebec, Canada 

Ontario, Canada r 
Eng/Afr/Zulu - RSA (5) 5 
Dubai, UAE 

Abu Dhabi, UAE r 


Downloaded from http://pirls2016.org/download-center/ 


Often Engaged in Early 


Literacy Activities 


Percent Average Percent Average Percent Average Percent Average Percent Average Percent Average 
of Students} Achievement} of Students} Achievement} of Students} Achievement} of Students} Achievement] of Students} Achievement} of Students} Achievement 


31 (0.8) 
24 (1.1) 
22 (1.2) 
18 (1.3) 
9 (0.4) 
6 (0.5) 


616 (2.2) 
515 (3.4) 
564 (2.2) 
519 (3.6) 
547 (2.4) 
538 (2.4) 
569 (3.7) 
566 (4.6) 
462 (10.6) 
561 (4.0) 
486 (11.1) 


Engaged in Early 
Literacy Activities 


22 (0.8) 
37 (1.2) 
27 (0.7) 
62 (0.9) 
24 (0.8) 
51 (0.9) 
34 (1.0) 
17 (1.1) 
29 (1.3) 
13 (0.6) 
11 (0.5) 


603 (3.1) 
481 (4.3) 
547 (3.0) 
496 (3.0) 
523 (3.1) 
512 (2.6) 
549 (3.5) 
550 (6.0) 
426 (9.8) 
525 (4.3) 
442 (7.3) 


Often Engaged in Early 


Literacy Activities 


6 (0.4) 
5 (0.5) 
8 (0.5) 
1 (0.2) 
10 (0.7) 
1 (0.2) 
6 (0.6) 
17 (0.9) 
6 (0.4) 
14 (0.9) 
12 (0.7) 


619 (4.6) 
477 (9.9) 
556 (4.5) 


535 (3.9) 
555 (7.8) 
566 (4.8) 
455 (10.1) 
550 (4.0) 
446 (7.4) 


Sometimes or Never 
Engaged in Early 
Literacy Activities 


3 (0.3) 
7 (0.6) 
6 (0.4) 
2 (0.2) 
10 (0.6) 
3 (0.3) 
8 (0.9) 
11 (0.6) 
13 (1.0) 
24 (0.6) 
31 (1.1) 


Often Engaged in Early 


Literacy Activities 


591 (7.2) 9 (0.6) 
459 (8.1) 4 (0.4) 
542 (4.0) 9 (0.6) 
~~ 1 (0.1) 
520 (4.4) 11 (0.6) 
493 (9.1) 4 (0.4) 
539 (5.1) 11 (0.6) 
534 (5.7) 16 (1.1) 
412 (9.2) 10 (0.7) 
500 (3.0) 13 (0.7) 
403 (6.0) 11 (0.7) 
ZF 
iF 


621 (4.2) 
467 (8.8) 
542 (3.6) 
520 (4.1) 
524 (6.9) 
553 (5.5) 
549 (4.8) 
402 (9.7) 
537 (3.5) 
441 (7.1) 


Sometimes or Never 


Engaged in Early 
Literacy Activities 


4 (0.4) 

6 (0.5) 
10 (0.7) 

1 (0.2) 
14 (0.8) 
10 (0.5) 
17 (0.9) 
17 (1.0) 
24 (1.5) 
26 (0.8) 
30 (1.1) 


584 (6.7) 
432 (7.4) 
526 (4.7) 
502 (4.0) 
501 (3.7) 
533 (4.1) 
528 (4.4) 
385 (7.1) 
495 (2.9) 
404 (5.1) 
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Exhibit 4.8: Could Do Literacy Tasks When Beginning Primary School 
To provide information about the extent to which students enter primary school equipped with some 
basic skills as a foundation for formal reading instruction, the PIRLS assessments have included a 
set of questions (see the second page of Exhibit 4.8) asking parents how well their child could do 
various literacy activities when he or she first entered primary school. Parents’ reports indicate that 
early preparation appears to have an effect through the fourth grade. Exhibit 4.8 shows, on average 
across countries, that 29 percent of the students entered school able to perform early literacy tasks 
Very Well according to their parents and another 35 percent Moderately Well. Parent assessment of 
their children’s early literacy skills corresponded well with reading achievement at the fourth grade, 
with the children able to perform Very Well having higher achievement than those performing 
Moderately Well (537 vs. 510). The 36 percent of the students in the Not Well category had the 
lowest achievement (485). 

In 16 countries, students entered primary school with higher average scores in PIRLS 2016 

than in PIRLS 2011 on the scale named Early Literacy Tasks. This agrees with the results in Exhibit 
4.5 where parents reported more time spent with their children on early literacy development. 
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Exhibit 4.8: Could Do Literacy Tasks When Beginning Primary School 


Students Categorized by Parents' Reports 

Students were scored according to their parents’ responses to how well their children could do the six tasks on the Early Literacy 
Tasks scale. Students who could do literacy tasks Very Well had a score on the scale of at least 11.6, which corresponds to their 
parents reporting that the students could do three literacy tasks “very well” and the other three “moderately well,” on average. 
Students doing the tasks Not Well had a score no higher than 9.5, which corresponds to parents reporting that students could do 
three tasks “not very well” and the other three “moderately well,” on average. All other students could do the literacy tasks 


Moderately Well when they began primary school. 


Very Well Moderately Well Arete Difference in 
Country Percent Average Percent Average Soe ee Average Scal i Average Scale Score 
cale Score 
ue ae ee uk ae ae a ae Achievement from 2011 
5.1) 


SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 


lreland 519 (5.7) 12.0 (0.04 -- 

Bahrain . : a im on a on - 383 ( 11.5 (0.03 -- 
Trinidad and Tobago 52 (1.1 513 (3.3) 38 (1.0) 465 (3.7) 10 (0.7) 432 (7.3) 11.6 (0.04) 0.3 (0.05) © 
Singapore 50 (1.2 608 (2.8) 38 (0.8) 561 (3.0) 12 (0.7) 503 (5.1) 11.6 (0.05) 0.5 (0.06) © 
Spain 48 (1.0 551 (1.5 35 (0.9) 519 (2.5) 17 (0.7) 496 (3.6) 11.3 (0.04 0.4 (0.06) © 
Qatar 45 (0.7 478 (2.3 36 (0.7) 444 (2.7) 19 (0.5) 402 (4.4) 11.2 (0.02 0.2 (0.04) © 
United Arab Emirates 44 (0.7 492 (3.5) 36 (0.5) 451 (3.4) 20 (0.6) 388 (3.5) 11.1 (0.03) 0.5 (0.04) © 
Kuwait 6 433 432 (3.7) 34 (0.9) 393 (4.7) 23: (1,1) 352 (7.2) 10.9 (0.05) -- 

Israel 42 (1.0 539 (3.2 31 (0.8) 531 (3.1) 26 (0.9) 535 (3.9) 10.9 (0.05) + 0.0 (0.07) 
Oman 42 (0.7 459 (3.7 39 (0.5) 409 (3.4) 20 (0.6) 358 (4.3) 11.0 (0.03 0.2 (0.05) © 
Poland 41 (1.1 587 (2.5) 35 (1.0) 558 (2.7) 24 (0.8) 540 (3.0) 10.9 (0.04) -- 

Latvia 41 (1.1 581 (1.9) 41 (0.9) 553 (1.9) 18 (0.8) 522 (3.5) 11.1 (0.04) -- 

Saudi Arabia 37 (1.2 453 (4.2 36 (0.9) 426 (4.9) 27 (1.3) 414 (7.8) 10.7 (0.06 0.0 (0.11) 
South Africa S35: 110 349 (6.5 39 (0.8) 335 (6.1) 25 (1.3) 297 (7.0) 10.8 (0.06) s 0.5 (0.07) © 
Canada tr 34 (0.7 576 (2.0) 38 (0.7) 546 (2.1) 28 (0.7) 522 (3.0) 10.7 (0.03) -- 

Macao SAR 33 (0.6 570 (1.9) 52 (0.7) 539 (1.6) 15 (0.6) 513 (2.8) 11.0 (0.02) -- 

Egypt 33 (1.8 392 (5.0 35 (1.3) 332 (5.3) 32 (2.0) 267 (9.4) 10.4 (0.10 -- 
Chinese Taipei 33 (0.7 586 (2.3 52 (0.8) 555 (2.1) 16 (0.7) 520 (4.0) 11.0 (0.03 0.4 (0.04) © 
Finland 31 (0.8 602 (2.4) 25 (0.9) 569 (3.0) 44 (0.9) 546 (2.2) 10.3 (0.03) 0.1 (0.06) 
Kazakhstan 31 (1.2 553 (3.2) 47 (1.1) 532 (2.7) 22 (1.0) 523 (3.3) 10.8 (0.05) -- 
Sweden 29 (0.9 591 (2.8 37 (1.1) 561 (2.8) 34 (1.2) 532 (2.9) 10.4 (0.04 0.1 (0.06) 
Chile 28 (0.8 529 (3.6 35 (0.8) 497 (3.3) 37 (0.9) 472 (2.7) = (0.04 -- 
Morocco 28 (1.1 417 (3.9) 32 (1.0) 362 (4.4) 40 (1.6) 321 (4.9) 8 (0.11) -0.4 (0.15) 
Denmark 27 (0.9 579 (3.1 42 (1.1) 550 (2.6) 31 (1.1) 524 (3.0) Ba. (0.04) 0.2 (0.05) © 
Hong Kong SAR 27 (1.2 591 (3.1 57 (1.0) 572 (2.4) 16 (0.9) 524 (4.8) 10.9 (0.05 -0.1 (0.06) 
Lithuania 26 (0.7 591 (2.9 44 (1.0) 551 (3.4) 30 (0.9) 512 (3.2) 10.5 (0.03 0.4 (0.05) © 
Bulgaria 25 (1.0 591 (3.8) 34 (1.3) 567 (4.1) 40 (1.8) 518 (6.1) 9.9 (0.10) 0.1 (0.15) 
Malta 24 (0.8 490 (2.6) 37 (0.9) 466 (2.8) 39 (1.0) 433 (2.3) i (0.04) 0.1 (0.05) 
Iran, Islamic Rep. of 24 (1.2 453 (5.2 31 (1.1) 433 (4.6) 46 (1.9) 415 (4.9) 7 (0.11 0.0 (0.12) 
Azerbaijan 23 (0.9 495 (4.0 33 (0.7) 479 (5.3) 44 (1.2) 460 (5.0) 8 (0.07 0.3 (0.11) 
Georgia 23 (1.1 506 (3.7) 31 (0.9) 497 (3.4) 46 (1.4) 479 (3.4) .7 (0.08) 0.1 (0.09) 
Russian Federation 23 (0.8 613 (2.6) 39 (0.9) 587 (2.3) 39 (1.1) 556 (3.1) a (0.05) 0.3 (0.08) © 
Czech Republic 22 (0.7 567 (3.5 34 (0.9) 542 (2.8) 44 (0.9) 537 (2.4) 9 (0.04) 0.2 (0.05) © 
France 20 (0.7 532 (2.9 42 (1.0) 517 (2.8) 38 (1.1) 501 (3.1) - (0.04 -0.1 (0.05) 
Slovenia 14 (0.7 585 (3.1) 25 (0.8) 556 (3.0) 61 (1.0) te (2.9) 9.1 (0.05) -0.2 (0.06) @ 
Netherlands s 13 (0.8 576 (4.4) 36 (1.2) 556 (3.1) 51 (1.4) 44 (2.4) 9.5 (0.05) s 0.3 (0.07) O 
Italy 13 (0.7 565 (3.6 32 (0.9) 554 (3.3) 55 (0.8) 7 (2.5) 9.4 (0.04 0.1 (0.05) 
Portugal 13 (0.6 548 (3.0 36 (0.9) 53127) 51 (0.9) 522 (2.9) 9.6 (0.04 0.2 (0.06) © 
Austria 13 (0.7 549 (4.2) 26 (0.7) 535 (3.6) 62 (0.9) 545 (2.0) 9.2 (0.04) 0.1 (0.05) 
Norway (5) 12 (0.6 594 (3.8) 24 (0.8) 569 (3.1) 64 (0.8) 550 (2.3) 9.1 (0.03) -- 
Hungary 11 (0.5 578 (6.1 19 (0.7) 561 (4.5) 70 (1.0) 551 (2.8) 8.6 (0.06 -0.2 (0.07) @ 
Belgium (Flemish) 10 (0.6 527 (4.7 29 (0.9) 522 (2.6) 61 (1.2) $31 (1.7) 9.0 (0.05 -- 
Belgium (French) 10 (0.6 513 (4.2) 30 (0.8) 501 (3.5) 60 (1.0) 496 (2.8) 9.3 (0.04) -0.1 (0.05) 
Germany ff 8 (0.6 571 (5.6) 25 (0.9) 549 (4.1) 67 (1.0) 545 (3.5) 9.0 (0.04) r+ -0.2 (0.05) @ 
Slovak Republic 8 (0.6 542 (9.0 19 (0.6) 551 (3.4) 73 (0.7) 532 (3.8) 8.6 (0.04 0.1 (0.06) 
England -- -- -- -- -- - -- -- 
Northern Ireland -- -- -- -- -- -- -- -- 

United States -- -- - -- -- -- -- -- 

New Zealand x 24 (1.1) 562 (5.2) 45 7 Ye) 542 (4.0) 31 (1.1) 531 (3.7) 10.4 (0.05) x 0.6(0.07) O 
euerele xX 19 : 7 594 e : * (1 2 565 as = (1.1) ? 551 (3.6) 9.9 (0.04) x 0.2 (0.06) O 

#5 08 


This PIRLS questionnaire scale was established in 2011 based on the combined response distribution of all countries that Significantly higher than 2011 © 
participated in PIRLS 2011. To provide a point of reference for country comparisons, the scale centerpoint of 10 was located Significantly lower than 2011 @ 
at the mean of the combined distribution. The units of the scale were chosen so that 2 scale score points corresponded to 

the standard deviation of the distribution. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A dash (-) indicates comparable data not available. 
An “r" indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are available for at least 50% but less than 70% of the students. 
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(Continued) 


Benchmarking Participants 


Ontario, Canada 
Abu Dhabi, UAE 
Eng/Afr/Zulu - RSA (5) S 
Moscow City, Russian Fed. 

Buenos Aires, Argentina 5 


Andalusia, Spain 


Quebec, Canada 


32 (1.0 
32 (1.0 
37 (0.7 
37 (1.3 
36 (1.0 
Al (1.2 
Al (0.9 
38 (1.0 
Al (1.0 
39 (1.2 
24 (0.7 


543 ( 


485 ( 


2.4 
2.7 
2.3 
BY) 
5.3 
7.5 
2.2 
BY 
4.3 


2.9) 


2.8 


Exhibit 4.8: Could Do Literacy Tasks When Beginning Primary School 


Very Well Moderately Well Not Well 


Percent Average Percent Average Percent Average 
of Students | Achievement | of Students | Achievement | of Students | Achievement 


13 (0.7) 519 (3.7) 
19 (0.8) 496 (3.4) 
16 (0.6) 467 (3.7) 
22 (1.1) 514 (4.9) 
23 (1.0) 355 (5.6) 
23 (1.1) 385 (8.2) 
27 (1.1) 579 (2.6) 
32 (1.0) 469 (4.3) 
32 (0.9) 469 (3.1) 
38 (1.3) 539 (3.9) 
64 (0.9) 506 (2.2) 


How well could your child do the following when he/she began the first grade 


of primary/elementary school? 


1 
2 
3 
4 


) 
) 
) 
) 
) 
) 


6 


Downloaded from http://pirls2016.org/download-center/ 


Read some words 

Read sentences 

Read a story: 

5) Write letters of the alphabet 


Write some words 


Recognize most of the letters of the alphabet 


Very well 


Moderately Not very 
well well 


Moderately 
Well 


9.5 


Average Scale Score 


Significantly higher than 2011 @ 
Significantly lower than 2011 @ 


SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 
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Socioeconomic Composition of Schools 


"sUDENTsD DO 


PNae-vave(-leMvautelel cy 
with more affluent than 
disadvantaged students 


raceory 33% 


Average 


Attended schools with 
neither more affluent 
kelmcleMelet-Tehelal ele (te 
students 


WAU 


“subeNTsD 29% 


Average 


MN ac-yave(-emyantele Mn tan 
kel e-MelttLeM ela cle(-fe| 
than affluent students 


schools with more affluent than disadvantaged students 


b In nearly all the PIRLS 2016 countries, students attending 


had higher average reading achievement. 


Achievement Higher 
in Schools Where 
Students Enter with 
Early Literacy Skills 


Students in schools where 
a higher proportion of their 
peers had early reading 
and writing skills when 
entering first grade 

had higher average 
reading achievement 

at the fourth grade. 


>75% ot entering 
} students had literacy skills 


PERCENT OF 
STUDENTS 


47% 40ers 


3 1 % r base hl 


STUDENTS 


Average 
Achievement 


Average 
Achievement 


grades with literacy skills. Only 1 country had a decrease. 


) In 8 countries there was an increase in students entering the primary 


Instruction Affected by Reading Resource 
Shortages — Principals’ Reports 


Percent of Students 
Not Affected 


31% 


Average 
Achievement 


Percent of Students 
Somewhat Affected 


62% 


Average 
Achievement 


SOURCE: IEA's Progress in International Reading 


Literacy Study — PIRLS 2016 


http://pirls2016.0rg/download-center/ 


Percent of Students 
Affected a Lot 


6% 


Average 
Achievement 
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CHAPTER 5 


School Composition and Resources 


Exhibit 5.1: School Composition by Socioeconomic Background of the 

Student Body 

Exhibit 5.1 provides information about the socioeconomic composition of the schools attended 
by fourth grade students. As reported by principals, on average, 38 percent of the students were in 
schools with relatively more affluent than disadvantaged students, 33 percent in schools where there 
was a balance, and 29 percent in schools with relatively more disadvantaged than affluent students. 
Higher average reading achievement was associated with attending schools with a higher percentage 
of economically advantaged students (530, 513, and 487, respectively). 
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Exhibit 5.1: School Composition by Socioeconomic Background of the WAU ip crace 
Student Body 
Students Categorized by Principals' Reports 


More Affluent - Schools where more than More Disadvantaged - Schools where more 
25% of the student body comes from Neither More Affluent Nor More than 25% of the student body comes from 
economically affluent homes and economically disadvantaged homes 
not more than 25% from and not more than 25% from 
economically disadvantaged homes economically affluent homes 


Disadvantaged 


Country 


Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Australia 35 (3.2) 570 (4.6) 38 (3.3) 545 (3.2) 26 (2.9) 509 (4.3) 
Austria 29 (4.0) 558 (3.5) 45 (3.9) 545 (2.3) 25 (3.6) 512 (5.7) 
Azerbaijan r W2} 502 (13.6) 23 (4.0) 469 (8.5) 66 (4.1) 471 (4.9) 
Bahrain 31 (1.6) 473 (5.5) 36 (3.0) 446 (3.4) 33 (3.0) 419 (5.4) 
Belgium (Flemish) 67 (4.0) 535 (2.0) 23 (3.6) 515 (4.2) 10 (2.7) 487 (6.1) 
Belgium (French) 56 (3.6) 515 (3.2) 24 (3.8) 493 (4.5) 21 (3.0) 461 (5.4) 
Bulgaria 15 (3.5) 585 (7.9) 51 (4.3) 565 (5.4) 34 (3.6) 520 (7.9) 
Canada 42 (2.7) 556 (2.2) 38 (2.3) 546 (2.9) 21 (2.1) 513 (4.5) 
Chile 18 (2.3) 546 (3.1) 9 (2.7) 500 (9.3) 74 (3.1) 481 (3.5) 
Chinese Taipei 23 (3.4) 575 (3.8) 62 (4.3) 558 (2.3) 15 (2.9) 536 (3.9) 
Czech Republic 42 (3.7) 554 (2.6) 51 (4.1) 540 (2.5) 7 (1.9) 506 (15.8) 
Denmark 63 (4.1) 554 (2.9) 29 (3.8) 538 (4.0) Ti} 538 (5.7) 
Egypt 25 (3.7) 375 (14.6) 16 (3.6) 344 (14.9) 59 (4.7) 306 (7.4) 
England 38 (3.6) 575,35) 30 (3.9) 563 (3.3) 32 (3.7) 539 (3.5) 
Finland 42 (3.7) 570 (3.0) 49 (4.1) 567 (2.9) 9 (1.8) 544 (8.0) 
France 41 (4.5) 524 (3.4) 30 (4.1) 517 (4.4) 29 (3.3) 489 (3.9) 
Georgia 23 (3.5) 507 (5.6) 31 (3.7) 484 (5.5) 46 (3.9) 486 (4.7) 
Germany 22 (3:1) 560 (4.3) 48 (4.1) 547 (3.9) 30 (3.6) 504 (9.1) 
Hong Kong SAR 32 (3.8) 570 (4.6) 28 (4.2) 573 (5.1) 39 (3.4) 571 (5.1) 
Hungary 34 (3.6) 579 (4.9) 29 (4.2) 562 (4.1) 37 (3.5) 522 (5.2) 
Iran, Islamic Rep. of 28 (3.9) 462 (6.8) 18 (3.0) 457 (8.1) 55 (4.2) 400 (7.0) 
lreland 43 (4.5) 582 (3.5) 32 (4.4) 570 (3.5) 25 (3.6) 534 (4.0) 
Israel 30 (3.0) 561 (5.1) 33 (3.8) 549 (6.8) 36 (3.1) 489 (5.4) 
Italy 32 (4.2) 555 (4.2) 50 (4.6) 547 (3.2) 18 (3.1) 539 (6.1) 
Kazakhstan 70 (3.8) 542 (3.3) 24 (3.5) 517 (5.6) 6 (2.0) 524 (7.2) 
Kuwait r 39 (4.1) 408 (8.4) 27 (4.0) 382 (10.4) 34 (4.5) 385 (11.7) 
Latvia 21 (3.7) 562 (4.7) 69 (4.4) 560 (2.3) 10 (2.4) 533 (7.8) 
Lithuania 65 (3.4) 560 (2.8) 23 (3.3) 539 (5.3) 13 (2.6) 503 (8.7) 
Macao SAR 37 (0.1) 541 (2.1) 26 (0.1) 548 (1.9) 36 (0.1) 549 (2.0) 
Malta 39 (0.1) 441 (2.6) 58 (0.1) 461 (2.1) 3 (0.1) 415 (8.2) 
Morocco r 8 (1.9) 434 (14.1) 8 (1.7) 404 (13.2) 84 (1.9) 343 (5.0) 
Netherlands r 55 (4.9) 555 (2.4) 33 (4.8) 543 (3.3) 12 BA) 515 (7.2) 
New Zealand r 40 (3.4) 551 (2.9) 31 (3.6) 527 (6.0) 29 (3.0) 484 (7.5) 
Northern Ireland s 36 (5.2) 583 (4.3) 34 (5.8) 562 (5.1) 30 (3.9) 547 (5.0) 
Norway (5) 54 (4.7) 563 (3.2) 38 (4.3) 555 (2.9) 8 (2.2) 546 (6.8) 
Oman 44 (3.1) 430 (5.6) 39 (3.1) 413 (5.2) 18 (2.7) 402 (5.4) 
Poland 19 (3.9) 572 (6.3) 60 (4.7) 566 (2.6) 21 (3.2) 545 (5.6) 
Portugal 14 (2.4) 543 (5.3) 45 (4.7) 529 (4.2) 42 (4.8) 521 (3.2) 
Qatar r 70 (0.4) 449 (2.4) 22 (0.4) 450 (3.8) 8 (0.2) 422 (11.9) 
Russian Federation 71 (3.3) 585 (2.9) 24 (3.2) 578 (5.7) 5 (1.4) 558 (9.4) 
Saudi Arabia r 43 (3.7) 437 (8.8) 29 (3.8) 424 (9.0) 28 (4.1) 424 (10.6) 
Singapore 42 (0.0) 597 (4.8) 44 (0.0) 568 (4.9) 13 (0.0) 536 (10.4) 
Slovak Republic 37 (3.6) 551 (3.7) 51 (4.1) 542 (3.6) 11 (2.7) 449 (16.7) 
Slovenia 35 (4.6) 546 (3.8) 38 (4.2) 543 (3.4) 27 (4.8) 537 (4.5) 
South Africa r 9 (2.0) 428 (23.1) 16 (3.0) 310 (17.3) 75 (3.7) 309 (4.8) 
Spain 54 (3.0) 535 (1.9) 31129) 520 (4.3) 15 (2.1) 5116.1) 
Sweden 78 (3.9) 562 (2.8) 18 (3.5) 539 (4.0) 4 (1.4) 508 (18.7) 
Trinidad and Tobago i 25 (3.7) 526 (6.8) 21 (3.8) 493 (8.6) 54 (4.5) 463 (5.7) 
United Arab Emirates r 50 (2.2) 473 (6.2) 25 (1.9) 453 (6.5) 25 (2.0) 409 (6.5) 
United States 15 (3.0) 588 (4.3) 21 (3.7) 566 (5.4) 63 (4.0) 532 (3.7) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A tilde (~) indicates insufficient data to report achievement. 
An “r" indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are available for at least 50% but less than 70% of the students. 
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Benchmarking Participants 


Buenos Aires, Argentina 
Ontario, Canada 
Quebec, Canada 


Moscow City, Russian Fed. 
Eng/Afr/Zulu - RSA (5) 
Andalusia, Spain 


Abu Dhabi, UAE 


not more than 25% from 


economically disadvantaged homes 


57 (5.6) 
40 (5.1) 
57 (4.7) 
63 (3.7) 
54 (4.6) 
80 (3.3) 
17 (3.2) 
46 (4.0) 
58 (4.5) 
47 (3.5) 
57 (0.3) 
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504 (4.3) 
554 (5.1) 
555 (2.8) 
511 (3.3) 
524 (2.6) 
615 (2.3) 


499 (17.4) 


535 (2.6) 
554 (2.5) 
424 (9.7) 
538 (2.8) 


1) Come from economically disadvantaged homes 


2) Come from economically affluent homes 


Exhibit 5.1: School Composition by Socioeconomic Background of the 
Student Body (Continued) 
More Affluent - Schools where more than 


25% of the student body comes from 
economically affluent homes and 


Neither More Affluent Nor More 


Disadvantaged 


15 (4.0) 
41 (4.6) 
22 (3.5) 
28 (3.5) 
39 (4.2) 
18 (3.1) 
7 (3.4) 
31 (3.4) 
24 (4.1) 
22 (3.3) 
33 (0.2) 


0 to 10% 


11 to 25% 


459 (8.8) 
548 (4.6) 
554 (8.3) 
488 (5.5) 
512 (3.4) 
600 (5.4) 


431 (38.3) 


524 (3.0) 
551 (5.1) 


404 (13.3) 


513 (3.2) 


26 to 50% 


More Disadvantaged - Schools where more 
than 25% of the student body comes from 
economically disadvantaged homes 


and not more than 25% from 
economically affluent homes 


Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement 


28 (4.9) 
19 (3.9) 
22 (4.5) 
9 (2.3) 
7 (2.0) 

1 (0.8) 
76 (4.6) 
23 (3.5) 
18 (3.3) 
30 (3.1) 
10 (0.2) 


Approximately what percentage of students in your school have the following backgrounds? 


More 


than 50% 


Neither More Affluent nor More Disadvantaged - All other possible response combinations 


g 
g 


More Affluent - Schools where more than 25% of the student body comes from economically affluent 
homes and not more than 25% from economically disadvantaged homes 


More Disadvantaged - Schools where more than 25% of the student body comes from economically 
disadvantaged homes and not more than 25% from economically affluent homes 


441 (7.1) 
518 (7.0) 
523 (5.9) 
487 (12.8) 
508 (5.0) 
389 (8.4) 
505 (6.8) 
528 (4.2) 
387 (8.2) 
415 (4.6) 


TIMSS & PIRLS 


IE A International Study Center 


Lynch School of Education 
BOSTON COLLEGE 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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2016 CiP crade 


Exhibit 5.2: Schools with Students Having the Language of the Test as Their 
Native Language 

Exhibit 5.2 presents principals’ categorizations of their schools according to the percentage of 
students who spoke the language of the PIRLS 2016 assessment as their first language. Sixty-three 
percent were in schools where most students (more than 90%) spoke the language of the PIRLS 
assessment as their first language, and another 20 percent were in schools where the majority of 
students (51-90%) spoke the language of the assessment as their first language. Both groups of 
students had higher average reading achievement than the 18 percent of students attending schools 
where only half of the students (or less) spoke the language of the assessment as their native language 
(512 and 515 vs. 493). 
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Exhibit 5.2: Schools with Students Having the Language of the Test PAU TS ip crade 
as Their Native Language 
Students Categorized by Principals' Reports 
School has More than 90% of Students School has 51-90% of Students School has 50% or Less of Students 
with Language of Test as Their with Language of Test as Their with Language of Test as Their 
Country Native Language Native Language Native Language 


Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement 


= 
Australia 50 (3.1) 552 (3.4) 28 (3.0) 535 (5.8) 23 (2.7) 538 (6.0) a 
Austria 29 (3.7) 552 (3.3) 46 (4.5) 546 (3.0) 25 (3.4) 519 (5.5) 5 
Azerbaijan 84 (2.7) 465 (4.8) 12 (2.4) 505 (10.2) 4 (1.7) 497 (12.9) 4 
Bahrain 62 (2.3) 435 (3.2) 15 (1.8) 470 (5.8) 23 (1.8) 462 (8.2) & 
Belgium (Flemish) 45 (3.4) 540 (2.1) 34 (4.2) 523 (3.6) 22 (3.5) 500 (4.9) iE 
Belgium (French) 63 (3.0) 509 (2.9) 21 (2.9) 498 (5.2) 16 (2.3) 457 (7.0) 2 
Bulgaria 55 (4.1) 580 (3.8) 25 (3.8) 545 (5.3) 20 (2.7) 482 (8.7) s 
Canada 47 (2.5) 545 (2.6) 34 (2.6) 545 (3.6) 19 (2.0) 536 (4.2) g 
Chile 98 (1.1) 494 (2.7) 2 (1.1) iad 0 (0.0) as é 
Chinese Taipei 66 (4.2) 562 (2.4) 27 (3.9) 557 (3.7) 7 (2.2) 541 (7.4) = 
Czech Republic 92 (2.0) 543 (2.3) 7 (1.9) 547 (5.6) 0 (0.4) ad a 
Denmark 60 (3.5) 553 (2.7) 31 (3.5) 541 (3.4) 9 (2.0) 532 (8.3) & 
Egypt 97 (1.4) 334 (5.6) 1 (1.0) ~~ 1 (1.0) ~~ g 
England 45 (3.6) 566 (3.3) 29 (3.6) 557 (4.2) 27 (3.3) 548 (3.8) 
Finland 82 (2.7) 570 (1.8) 16 (2.8) 553 (6.1) 2 (1.3) iad 
France 65 (3.6) 519 (3.3) 26 (3.4) 499 (4.2) 9 (2.4) 492 (8.8) 
Georgia 85 (2.1) 493 (3.0) 9 (1.5) 485 (8.8) 6 (1.8) 441 (18.6) 
Germany 30 (2.8) 554 (3.9) 48 (3.4) 540 (5.6) 22 (2.9) 502 (7.2) 
Hong Kong SAR 96 (1.9) 570 (2.9) 4 (1.9) 559 (10.0) 0 (0.0) iad 
Hungary 99 (0.4) 553 (2.8) 0 (0.4) ws 0 (0.0) iad 
Iran, Islamic Rep. of 50 (3.6) 456 (5.0) 8 (1.5) 469 (7.6) 42 (3.3) 386 (8.3) 
Ireland 57 (3.7) 573 (3.1) 32 (3.8) 563 (4.5) 11 (3.2) 546 (7.8) 
Israel 69 (3.2) 523 (3.3) 23 (3.2) 556 (6.0) 8 (2.0) 527 (9.9) 
Italy 60 (3.4) 547 (3.4) 39 (3.3) 552 (2.8) 1 (0.7) ~~ 
Kazakhstan 53 (2.7) 530 (3.3) 32 (3.3) 544 (5.1) 14 (2.8) 541 (6.7) 
Kuwait 20 (3.7) 380 (7.6) 27 (3.2) 405 (10.2) 53 (3.5) 394 (5.8) 
Latvia 47 (3.2) 557 (2.5) 26 (3.1) 549 (4.0) 27 (1.3) 568 (3.3) 
Lithuania 87 (2.1) 548 (2.8) 11 (1.9) 567 (6.3) 2 (1.1) ~~ 
Macao SAR 87 (0.1) 550 (1.1) 2 (0.0) ~~ 11 (0.1) 515 (3.9) 
Malta 60 (0.1) 461 (2.2) 35 (0.1) 446 (2.4) 5 (0.1) 382 (7.3) 
Morocco 9 (1.4) 398 (11.5) 14 (1.9) 397 (8.5) 77 (2.3) 346 (5.1) 
Netherlands 72 (4.0) 550 (2.2) 22 (3.6) 542 (3.5) 6 (2.0) 518 (20.3) 
New Zealand 56 (3.6) 531 (2.9 28 (3.0) 529 (6.3) 16 (2.2) 495 (11.4) 
Northern Ireland r 81 (3.9) 565 (2.9 14 (3.4) 561 (11.4) 5 (2.5) 560 (11.4) 
Norway (5) 63 (3.7) 559 (2.9 32 (3.8) 560 (3.8) 5 (1.7) 551 (4.7) 
Oman 82 (1.7) 415 (3.8) 5 (1.4) 409 (12.4) 13 (0.9) 445 (6.1) 
Poland 100 (0.0) 565 (2.1 0 (0.0) ~~ 0 (0.0) ~~ 
Portugal 89 (2.5) 528 (2.1) 8 (2.1) 520 (6.5) 3 (1.4) 555 (48.0) 
Qatar 41 (0.3) 405 (2.5 10 (0.1) 453 (4.1) 49 (0.3) 471 (3.1) 
Russian Federation 71 (2.6) 583 (2.8) 12 (2.3) 588 (5.5) 11 (1.7) 556 (8.3) 
Saudi Arabia 31 (3.4) 439 (7.5 26 (2.9) 437 (9.0) 43 (3.7) 420 (7.2) 
Singapore 0 (0.0) ~~ 0 (0.0) ~~ 100 (0.0) 576 (3.2) 
Slovak Republic 86 (2.7) 542 (3.0) 9 (1.8) 519 (10.0) 5 (1.9) 439 (25.2) 
Slovenia 74 (4.4) 544 (2.1) 25 (4.3) 538 (5.0) 2 (1.1) ~~ 
South Africa t 59 (2.6) 306 (4.5) 19 (2.6) 335 (11.6) 22 (2.3) 349 (12.2) 
Spain 56 (2.7) 536 (1.7) 28 (2.7) 521 (3.5) 16 (2.2) 513 (7.1) 
Sweden 47 (4.0) 563 (3.3) 37 (4.1) 550 (3.1) 16 (3.7) 541 (8.3) 
Trinidad and Tobago 94 (2.1) 486 (3.4) 0 (0.0) ~~ 6 (2.1) 475 (16.0) 
United Arab Emirates 36 (1.2) 397 (3.9) 7 (1.1) 471 (17.9) 58 (1.2) 480 (5.0) 
United States 55 (3.7) 557 (3.5) 30 (4.2) 550 (4.9) 15 (3.1) 517 (9.2) 


International Avg. 63 (0.4) PICS) 20 (0.4) EOE) 493 (1.9) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A tilde (~) indicates insufficient data to report achievement. 
An “r" indicates data are available for at least 70% but less than 85% of the students. 
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Exhibit 5.2: Schools with Students Having the Language of the Test 


as Their Native Language (Continued) 


School has More than 90% of Students 
with Language of Test as Their 


Country Native Language 


Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement 


Benchmarking Participants 


Buenos Aires, Argentina 90 (2.4) 
Ontario, Canada 43 (4.8) 
Quebec, Canada 49 (4.3) 
Denmark (3) 60 (3.7) 
Norway (4) 62 (3.9) 
Moscow City, Russian Fed. 68 (4.1) 
Eng/Afr/Zulu - RSA (5) r 43 (4.0) 
Andalusia, Spain 85 (3.1) 
Madrid, Spain 78 (3.1) 
Abu Dhabi, UAE 47 (2.0) 
Dubai, UAE 13 (0.1) 
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486 (3.6) 
546 (5.2) 
551 (3.9) 
500 (3.6) 
518 (2.6) 
615 (2.5) 
384 (6.7) 
527 (2.2) 
553 (2.3) 
372 (5.7) 
437 (3.7) 


School has 51-90% of Students 
with Language of Test as Their 
Native Language 


32 (3.6) 
32 (3.9) 
32 (4.1) 
22 (4.8) 
14 (3.1) 
17 (3.3) 
4 (2.2) 
11 (0.1) 


443 (15.4) 
543 (5.4) 
556 (6.2) 
504 (4.5) 
518 (3.1) 
605 (4.3) 
440 (18.4) 
518 (5.1) 
539 (3.1) 
387 (36.5) 
534 (3.0) 


School has 50% or Less of Students 
with Language of Test as Their 
Native Language 


1 (0.9) 
18 (3.3) 
26 (4.1) 

9 (2.1) 


ZF 
iF 


543 (4.9) 
533 (5.6) 
489 (14.9) 
503 (6.0) 


424 (15.5) 
529 (10.9) 
453 (8.0) 
526 (2.4) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 5.3: Schools Where Students Enter the Primary Grades with 
Literacy Skills 
Exhibit 5.3 presents principals’ categorizations of their schools according to the percentage of 
students entering the primary grades with early literacy skills (see the exhibit for details). There 
was considerable variation in the highest category—more than 75 percent entering with literacy 
skills—from 96 percent in Ireland where many students start preprimary school after their fourth 
birthday (see Exhibit 2) to 0 percent in Slovak Republic, Slovenia, Czech Republic, and Germany. 
On average, 22 percent were in schools where more than 75 percent of the students entered school 
with literacy skills, and another 47 percent were in schools where 25 to 75 percent entered with 
literacy skills. Both groups of students had higher average reading achievement than the 31 percent 
of students attending schools where less than 25 percent of the students entered with literacy skills 


(516 and 512 vs. 491). 
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Exhibit 5.3: Schools Where Students Enter the Primary Grades with Literacy Skills 


Students Categorized by Principals' Reports 

Students were scored according to their principals’ responses about the percentage of children in the school who begin first grade with the 
six key skills on the Schools Where Students Enter the Primary Grades with Literacy Skills scale. Students who attend Schools Where More than 
75% Enter with Skills had a score on the scale of at least 12.6, which corresponds to their principals reporting that over 75% of the students 
have three of the skills and 51-75% of the students have three of the skills, on average. Students who attend Schools Where Less than 25% 
Enter with Skills had a score no higher than 9.2, which corresponds to their principals reporting that less than 25% of the students have 
three of the skills and 25-50% of the students have three of the skills, on average. All other students attended Schools Where 25% to 75% 
Enter with Skills. 


Schools Where More than Schools Where 25-75% Schools Where Less than 25% 
75% Enter with Skills Enter with Skills Enter with Skills 


Difference in 
Average Scale Score 
from 2011 


Average 


Scale Score 


Countr 
2 Percent of Average Percent of Wael Percent of Average 
Students Achievement Students Achievement Students Achievement 


Ireland 96 (1.5) 570 a 545 (18.4) 0.1) ~ 14.2 (0.07) 
Northern Ireland r 94 (1.9) 567 (2.7 517 (14.4) : 8) oe 14.2 (0.09) oa 
Singapore 83 (0.0) 580 (3. 5 . mm 553 (9.5) 2 (0.0) ain 13.8 (0.00) 0.9 (0.00) © 
Spain 62 (3.2) 533 (1.8) 36 (3.2 519 (3.5) 2 (0.8) a= 12.8 (0.10) 0.4 (0.14) © 
United States 53 (4.8) 560 (3.8) 32 (4.4 540 (6.0 15 (3.2) 527 (7.9) 12.2 (0.22) ie 
Latvia 53 (4.7) 560 (2.8) 44 (4.6 557 (2.9 3 (1.3) 525 (12.5) 12.5 (0.14) a= 
Qatar 52 (0.3) 466 (2.4) 33 (0.3 420 (2.7) 15 (0.2) 411 (6.0) 12.0 (0.01) 0.6 (0.13) © 
England 46 (4.0) 567 (3.3) 41 (4.1 550 (3.8) 12 (2.6) 554 (5.6) 12.0 (0.17) =r -0.2 (0.23 
Chinese Taipei 42 (3.5) 557 (3.4) 50 (3.4 564 (2.3 8 (2.1) 540 (5.5) 12.1 (0.16) 0.4 (0.21 
United Arab Emirates Al (2.1) 497 (5.0) 43 (2.1 426 (5.3 16 (1.3) 394 (6.4) 11.7 (0.08) 0.5 (0.12) © 
Hong Kong SAR 38 (4.0) 567 (4.3) 50 (4.9 575 (3.2) 12 (3.7) 556 (13.1) 11.9 (0.20) -0.1 (0.25 
Denmark 36 (4.1) 553 (3.6) 59 (4.1 546 (2.9) 5 (1.6) 530 (9.0) 11.9 (0.10) 0.3 (0.13 
Bahrain 33 (2.5) 466 (4.3) 46 (3.2 444 (4.4 21 (2.5) 418 (5.7) 11.1 (0.10) + 
Macao SAR 33 (0.1) 542 (1.9) 55 (0.1 550 (1.4 13 (0.1) 538 (3.3) 11.5 (0.00) oe 
Canada 30 (2.5) 554 (3.2) 57 (2.6 546 (2.0) 13 (1.8) 508 (8.0) 11.5 (0.10) ole 
Kuwait 30 (4.6) 422 (10.4) 49 (5.0 386 (7.8) 21 (3.6) 378 (8.8) 11.1 (0.16) a 
Egypt 25 (3.4) 356 (15.3) 61 (4.2 321 (7.5 14 (3.1) 322 (15.5) 11.3 (0.15) a 
Sweden 23 (3.8) 569 (5.1) 72 (4.1 553 (2.6 5 (1.8) 519 (8.5) 11.5 (0.11) =r 0.0 (0.18) 
Kazakhstan 17 (2.6) 552 (8.0) 68 (3.5 533 (3.2) 15 (2.9) 532 (7.2) 11.0 (0.12) a8 
Chile 17 (3.4) 522 (6.8) 45 (4.3 506 (4.3) 38 (4.2) 467 (5.0) 10.1 (0.20) == 
Poland 14 (3.3) 558 (6.1) 56 (4.9 565 (2.9 30 (4.2) 567 (5.1) 10.2 (0.18) ie 
Bulgaria 12 (2.6) 573 (13.9) 60 (3.9 567 (4.6 28 (3.5) 509 (8.9) 10.3 (0.14) 0.6 (0.20) © 
Azerbaijan 12 (2.7) 481 (9.3) 42 (4.3 472 (8.2) 45 (4.0) 468 (5.6) 9.7 (0.17) 0.8 (0.21) © 
Morocco 12 (2.0) 405 (9.7) 36 (2.8 379 (5.5) 53 (3.1) 332 (5.7) 9.5 (0.13) -0.5 (0.18) @ 
Saudi Arabia 12 (2.3) 433 (12.4) 49 (3.8 425 (7.1 40 (3.6) 435 (7.2) 10.0 (0.14) 0.5 (0.21 
Georgia a (2.1) 495 (8.9) 30 (3.4 494 (4.2 59 (3.7) 485 (4.2) 9.4 (0.16) 0.0 (0.23 
Oman 1 (15) 435 (9.6) 61 (3.3 420 (4.4) 28 (3.1) 408 (5.9) 10.2 (0.09) 0.6 (0.16) © 
Israel ‘i (2.5) 506 (13.7) 53 (4.1 546 (5.3) 36 (3.9) 515 (7.1) 10.0 (0.16) -0.4 (0.21 
Malta 11 (0.1) 459 (4.7) 60 (0.1 454 (2.2 29 (0.1) 444 (3.0) 10.2 (0.00) 0.8 (0.01) © 
Finland 11 (2.7) 576 (5.3) 87 (3.0 564 (2.1 2 (1.2) me 11.3 (0.08) 0.3 (0.15 
Russian Federation 10 (2.1) 599 (6.9) 63 (2.9 588 (2.5) 27 (2.6) 556 (5.1) 10.3 (0.10) -0.1 (0.16 
Portugal 9 (3.2) 535 (4.4) 36 (3.8 530 (4.4) 55 (3.8) 525 (3.0) 9.3 (0.17) 0.5 (0.21 
Italy 8 (2.2) 542 (7.6) 52 (4.4) 552 (3.0 40 (4.6) 545 (4.0) 9.8 (0.16) 0.1 (0.19 
Iran, Islamic Rep. of 8 (2.1) 405 (27.3) 20 (3.6 432 (13.3) 72 (4.1) 429 (4.6) 8.6 (0.17) -0.2 (0.22 
Lithuania 8 (2.1) 555 (6.0) 66 (3.6 552 (3.4) 26 (3.5) 536 (4.8) 10.3 (0.13) 0.2 (0.16 
Austria 8 (2.2) 552 (5.2) 18 (3.5 553 (4.9) 74 (3.8) 537 (3.0) 8.8 (0.16) 0.3 (0.19 
Trinidad and Tobago 7 (2.3) 532 (13.1) 60 (4.5 491 (5.1 32 (4.2) 461 (6.5) 10.3 (0.15) -0.2 (0.19 
South Africa r 7 (2.4) 338 (34.2) 59 (3.9 317 (6.6 34 (3.8) 318 (8.4) 10.0 (0.17) r 0.3 (0.19 
France 6 (2.4) 512 (8.0) 85 (2.8 514 (2.7) 8 (1.9) 482 (7.2) 10.8 (0.09) -0.2 (0.13 
Australia 6 (1.4) 569 (7.8) 42 (3.1 550 (4.7) 52 (3.2) 536 (3.3) 9.2 (0.12) -0.1 (0.18 
New Zealand 5 (1.7) 523 (24.2) 51 (3.5 545 (3.0 44 (3.4) 502 (5.0) 9.4 (0.13) 0.3 (0.19 
Belgium (Flemish) 5 (1.9) 528 (5.1) 46 (4.7 529 (3.0 49 (4.7) 522 (3.8) 9.3 (0.18) =e 
Belgium (French) 3 (1.6) 512 (14.9) 72 (3.7 503 (3.0) 25 (3.5) 481 (6.2) 10.1 (0.13) 0.2 (0.19 
Norway (5) 2 (1.4) ce 67 (4.2 561 (2.8) 31 (4.1) 554 (3.3) 9.8 (0.14) -- 
Hungary 2 (1.2) mine 13 (3.1 575 (11.0) 85 (3.4) 550 (3.3) 8.0 (0.13) 0.1 (0.15 
Netherlands 2 (1.3) fl 64 (4.3 549 (2.2) 35 (4.5) 540 (3.9) 9.9 (0.12) 1 0.2 (0.16 
Slovak Republic 0 (0.2) me 30 (4.1 548 (4.3) 70 (4.1) 529 (4.8) 8.5 (0.10) 0.1 (0.14 
Slovenia 0 (0.0) = 47 (4.7 547 (3.3) (4.7) 539 (3.0) 9.1 (0.11) -0.1 (0.16 
Czech Republic 0 (0.0) anon a 4.0 550 (4.0) 71 (4.0) 541 (2.6) 8.6 (0.10) 0.2 (0.14 
SCE! = .0) nies ae 552 i or 2) 530 (4.9) 8.5 (0.09) -0.2 (0.13 
This PIRLS questionnaire scale was established in 2011 based on the combined response distribution of all countries that participated in Significantly higher than 2011 O 
PIRLS 2011. To provide a point of reference for country comparisons, the scale centerpoint of 10 was located at the mean of the Significantly lower than 2011 @ 
combined distribution. The units of the scale were chosen so that 2 scale score points corresponded to the standard deviation of the 
distribution. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. TIMSS & PIRLS 
A dash (-) indicates comparable data are not available. A tilde (~) indicates insufficient data to report achievement. LF ] EA International Study Center 
An “r” indicates data are available for at least 70% but less than 85% of the students. ww Lynch School of Education 
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Exhibit 5.3: Schools Where Students Enter the Primary Grades with Literacy Skills 


(Continued) 


Country 


Benchmarking Participants 


Madrid, Spain 

Dubai, UAE 

Andalusia, Spain 

Ontario, Canada 

Denmark (3) 

Abu Dhabi, UAE 

Moscow City, Russian Fed. 
Buenos Aires, Argentina 
Quebec, Canada 
Eng/Afr/Zulu - RSA (5) r 
Norway (4) 


Schools Where More than 
Percent of Average Percent of Average Percent of Average 


77 (3.7) 
62 (0.3) 
59 (3.5) 
47 (5.1) 
36 (3.8) 
26 (3.1) 
14 (2.9) 
8 (2.2) 
8 (2.9) 
5 (2.2) 
2 (1.1) 


553 (2.4) 
530 (2.4) 
531 (2.5) 
552 (4.8) 
506 (4.5) 
472 (11.2) 
615 (5.9) 
497 (13.1) 
560 (7.1) 
503 (24.7) 


Schools Where 25-75% 
Enter with Skills 


23 (3.7) 
28 (0.3) 
40 (3.6) 
45 (4.8) 
59 (4.0) 
52 (3.7) 
79 (3.3) 
66 (3.5) 
74 (4.6) 
66 (5.6) 
68 (4.1) 


535 (4.2) 
503 (3.4) 
518 (3.1) 
541 (4.1) 
499 (3.9) 


613 (2.2 
493 (4.0 
550 (2.7 
400 (8.6 


) 
) 
) 
) 
) 
522 (2.2) 


Schools Where Less than 25% 
Enter with Skills 


0 (0.0) 
10 (0.1) 
1 (0.9) 
8 (2.4) 
5 (1.7) 
22 (2.6) 
7 (2.2) 
26 (3.2) 
18 (4.1) 
29 (5.4) 
30 (4.1) 


444 (4.4) 
518 (11.4) 
493 (8.9) 
373 (11.4) 
596 (7.9) 
444 (6.2) 
536 (9.5) 
417 (14.5) 
507 (3.6) 


Difference in 
Average Scale Score 
from 2011 


Average 


Scale Score 


13.5 (0.10 ae 

12.6 (0.01 0.8 (0.03) © 
12.7 (0.11 0.7 (0.17) © 
12.2 (0.17 ee 

11.9 (0.09 


11.2 (0.12 
10.4 (0.12 
10.7 (0.17 
10.1 (0.20 
9.8 (0.13 


) 

) 

) 

) 

) am 
10.9 (0.13) 0.1 (0.22) 

) = 

) 

) 

) = 

) 0.0 (0.18) 


Significantly higher than 2011 @ 
Significantly lower than 2011 @ 


About how many of the students in your school can do the following when they begin the first grade of 
primary/elementary school? 


1) Recognize most of the letters of the alphabet 


Morethan 51-75% 


25-50% 


Less than 


25% 


2) Read some words -—--—---—--—-—---——---—--———-——-——-— CE) eC) ee (C) es 7) 


3) Read sentences -—---———--——--- a De CO) ee OC) eC) 


4) Read a story ---—---—---—----—---—---—---——--- OO OO 


5) Write letters of the alphabet 


6) Write some words —-—--------- a Ot CO) ee C) ee () 
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25-75% Enter 
with Skills 


Less than 
25% Enter 
92 with Skills 
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Exhibit 5.4: Instruction Affected by Reading Resource Shortages - 
Principals’ Reports 
Exhibit 5.4 presents the results for the Reading Resource Shortages scale. Countries are ordered 
according to the percentage of students (from most to least) in schools Not Affected by resource 
shortages, from a high of 64 percent to a low of 1 percent. On average, 31 percent of the fourth grade 
students attended well-resourced schools and they had the highest average reading achievement 
(521). Sixty-two percent of the students were in schools Somewhat Affected by resource shortages 


and 6 percent were in schools Affected A Lot. Average reading achievement for these two groups 
was 507 and 474, respectively. 


CHAPTER 5: SCHOOL COMPOSITION AND RESOURCES £ TIMSS & PIRLS 
4) International Study Center 184 
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Exhibit 5.4: Instruction Affected by Reading Resource Shortages - PAU TS ip crade 
Principals' Reports 
Students Categorized by Principals' Reports 
Students were scored according to their principals’ responses concerning twelve school and classroom resources on the Reading 
Resource Shortages scale. Students in schools where instruction was Not Affected by resource shortages had a score on the scale 


\" 


of at least 10.8, which corresponds to their principals reporting that shortages affected instruction “not at all” for six of the twelve 


resources and “a little” for the other six, on average. Students in schools where instruction was Affected A Lot had a score no 
higher than 7.1, which corresponds to their principals reporting that shortages affected instruction “a lot” for six of the twelve 
resources and “some” for the other six, on average. All other students attended schools where instruction was Somewhat 
Affected by resource shortages. 


Difference in 


Average 


Average Scale Score 


Scale Score 
from 2011 


Not Affected Somewhat Affected Affected A Lot 
Country Percent Average Percent Average Percent Average 
of Students | Achievement | of Students | Achievement | of Students | Achievement 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Australia 35 (3.3) 530 (4.7 11.5 (0.15 0.3 (0.21) 
Singapore 32 (0.0) 575 (6.1 ; om 601 (11.8) = 11.2 (0.00 0.8 (0.00) © 
Slovenia 7 rm 7 0 38 (4.6 539 (3.3 0 (0.0) ae 11.3 (0.14 -0.4 (0.18) 
Netherlands 62 (4.4) 547 (2.4 38 (4.4 544 (4.6 0 (0.0) we 11.3 (0.10) r 0.3 (0.15) 
Sweden 55 (4.3 560 (3.5 44 (4.3) 549 (3.1 0 (0.5) ae 11.3 (0.16 0.6 (0.22) 
Canada 55 (2.5 545 (2.4 44 (2.5) 542 (3.1 2 (0.7) so 11.0 (0.08 0.2 (0.12) 
Bulgaria 54 (3.7 559 (5.7 45 (3.6 541 (6.8 1 (0.7) eles 11.1 (0.12 0.1 (0.18) 
New Zealand 54 (3.7 530 (4.2 45 (3.7 522 (5.3 2 (1.0) me 10.9 (0.12 -0.3 (0.18) 
Poland 53 (4.3 568 (2.9 47 (4.3) 561 (3.4) 0 (0.0) aoe 11.0 (0.14 5 

United States 52 (4.0 555 (4.0 46 (4.1) 540 (5.3 2 (1.0) a1 op 11.0 (0.16 -0.2 (0.20) 
Czech Republic 51 (3.4) 543 (2.5 48 (3.4 544 (3.5 1 (0.6) ne 11.0 (0.10 0.4 (0.16) © 
England 51 (4.1 561 (2.9 49 (4.1 557 (3.2 0 (0.0) mee 10.9 (0.12 0.0 (0.22) 
Denmark 47 (4.2 550 (3.3 53 (4.1) 545 (2.9 0 (0.5) ad 10.9 (0.12 0.0 (0.17) 
Northern Ireland r 44 (5.6 564 (4.3 54 (5.6) 564 (3.9 2 (1.3) os 10.6 (0.16) r 0.0 (0.24) 
Norway (5) 42 (4.5 566 (3.1 57 (4.5 554 (2.9 0 (0.3) ae 10.7 (0.10 -- 
Germany 40 (3.7 547 (3.4 59 (3.8 530 (5.6 1 (0.6) oe 10.5 (0.10 0.0 (0.14) 
Slovak Republic 40 (3.8 535 (4.3 59 (3.7) 534 (5.0 1 (0.7) ~~ 10.4 (0.10 0.5 (0.14) © 
Bahrain 38 (3.0 463 (4.8 48 (3.1) 432 (3.8 14 (2.1) 449 (7.0) 10.0 (0.15 Se 

Spain 36 (2.9 537 (2.5 62 (3.0 524 (2.1 2 (0.8) fae 10.5 (0.09 -0.2 (0.17) 
Finland 36 (4.0 567 (3.8 62 (4.1 566 (2.5 2 (1.2) mee 10.5 (0.12 0.2 (0.20) 
Austria 36 (4.1 548 (3.5 64 (4.0) 536 (3.1 0 (0.5) ee 10.6 (0.11 -0.2 (0.17) 
Latvia 35 (4.3 554 (3.5 58 (4.2) 560 (2.5 7 (2.0) 554 (10.8) 10.0 (0.16 =e 

Ireland 34 (4.0 570 (3.1 66 (4.0 565 (3.2 0 (0.0) ais 10.3 (0.14 -0.2 (0.20) 
Chile 34 (4.6 508 (5.2 62 (4.8 485 (3.8 4 (1.9) 505 (8.5) 10.1 (0.16 = 

United Arab Emirates 31 (1.8 495 (5.7 53 (2.4) 426 (4.1 16 (1.7) 448 (9.4) 9.7 (0.10) 0.1 (0.14) 
Qatar 31 (0.4) 480 (3.8 34 (0.3) 435 (2.8 35 (0.3) 416 (2.8) 8.7 (0.02 -0.4 (0.26) 
Russian Federation 30 (3.4) 585 (5.0 65 (3.6 579 (3.1 4 (1.4) 576 (15.2) 10.1 (0.14 0.2 (0.21) 
Lithuania 30 (3.8 554 (4.8 68 (3.9 546 (3.7 2 (1.3) mea 10.0 (0.11 -0.2 (0.15) 
Belgium (Flemish) 30 (3.9 530 (4.3 70 (3.9) 524 (2.7 0 (0.2) aed 10.3 (0.11 oe 
Georgia 29 (3.3 500 (5.0 70 (3.2) 485 (3.8 1 (0.6) a) 10.2 (0.11 -0.4 (0.19) 
Kazakhstan 27 (4.2 543 (5.0 51 (4.2 531 (43 22 (3.5) 541 (5.2) 9.4 (0.22 _ 

Israel 26 (3.7 559 (4.6 60 (4.3 530 (5.1 14 (2.7) 481 (10.6) 9.4 (0.16 -0.2 (0.23) 
Malta 24 (0.1 454 (3.3 72 (0.1) 451 (1.9 5 (0.1) 464 (4.3) 9.7 (0.00 -0.6 (0.01) @ 
Oman 21 (2.3 439 (5.3 62 (2.9) 413 (43 17 (2.3) 414 (7.1) 9.1 (0.12) +r 07(0.15) O 
Belgium (French) 20 (3.3 500 (4.9 80 (3.3 498 (3.3 0 (0.0) ne 10.0 (0.09 0.2 (0.14) 
Portugal 20 (3.6 537 (7.4 78 (4.0 526 (2.3 2 (1.9) me 9.7 (0.11 0.0 (0.19) 
Chinese Taipei 17 (3.3 562 (4.2 69 (4.1) 559 (2.3 14 (2.9) 553 (5.3) 8.9 (0.14) 0.4 (0.21) 
France 17 (3.3 520 (5.3 83 (3.3) 510 (2.8 0 (0.0) 1 9.7 (0.10 -0.2 (0.15) 
Hungary 15 (3.1 551 (10.5) 82 (3.5 553 (3.0 4 (1.6) 560 (19.2) 9.6 (0.13 -0.9 (0.21) @ 
Italy 11 (2.2 553 (8.3 88 (2.1 548 (2.4 1 (0.9) me 9.5 (0.09 -0.2 (0.13) 
Egypt 10 (2.1 366 (22.5) 81 (3.2) 329 (6.0 9 (2.6) 308 (22.0 9.0 (0.15 oe 
Azerbaijan 8 (2.7 439 (27.2) 84 (3.3) 471 (3.9 7 (2.2) 514 (14.5 8.8 (0.16 0.5 (0.20) 
Morocco 8 (2.3 326 (12.8) 84 (3.1 360 (4.1 8 (2.3) 358 (23.8 8.9 (0.13 -0.7 (0.17) @ 
Iran, Islamic Rep. of TAVT, 482 (10.0) 78 (2.8 425 (5.0 15 (2.5) 414 (10.3 8.7 (0.11 0.3 (0.16) 
Trinidad and Tobago 6 (2.2 517 (21.1) 88 (3.1) 482 (4.1 6 (2.2) 483 (13.1 8.7 (0.12 0.2 (0.16) 
South Africa r 6 (1.6 410 (24.4) 89 (2.2) 314 (4.4 4 (1.5) 302 (31.9 9.1 (0.10) + 0.0 (0.14) 
Kuwait 4(15 444 (34.0) 59 (4.8 388 (6.6 37 (4.7) 400 (7.4) 7.6 (0.16 -- 

Macao SAR 4 (0.0 521 (3.9) 89 (0.1 546 (1.1 7 (0.1) 553 (4.3) 8.4 (0.00 == 

Saudi Arabia 2 ue ~~ 77 (2.6) 426 (4.5 21 (2.5) 446 (10.5 8.1 (0.10 -0.8 (0.21) @ 
Hong SU SAR 5 88 - : 571 . 7 R < 4) 559 « : 8.2 (0.08 0.2 (0.11) 


This PIRLS questionnaire scale was established in 2011 based on the combined response distribution of all countries that 
participated in PIRLS 2011. To provide a point of reference for country comparisons, the scale centerpoint of 10 was located at 
the mean of the combined distribution. The units of the scale were chosen so that 2 scale score points corresponded to the 
standard deviation of the distribution. 


Significantly higher than 2011 © 
Significantly lower than 2011 @ 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A dash (-) indicates comparable data not available. A tilde (~) indicates insufficient data to report achievement. 


An “r" indicates data are available for at least 70% but less than 85% of the students. TIMSS & PIRLS 
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Exhibit 5.4: Instruction Affected by Reading Resource Shortages - 


Principals' Reports (Continued) 


Country = Average ee Average a Average 
of Students | Achievement | of Students | Achievement | of Students | Achievement 


Benchmarking Participants 


Quebec, Canada 

Madrid, Spain 

Ontario, Canada 

Buenos Aires, Argentina 
Denmark (3) 

Moscow City, Russian Fed. 
Norway (4) 

Dubai, UAE 

Andalusia, Spain 

Abu Dhabi, UAE 
Eng/Afr/Zulu - RSA (5) r 


Ni | NotAffected =| 


61 (5.4) 
58 (3.8 
56 (4.3 
51 (4.2 
47 (3.9 
46 (4.0 


552 (3.0 
554 (2.8 
546 (3.7 
495 (4.6 
501 (4.2 
614 (3.5) 
522 (3.2 
527 (2.8 
534 (2.9 
471 (10.6) 
506 (22.7) 


| Somewhat Affected | Affected 


37 (5.6) 
42 3.8 
42 (4.3) 
49 (4.2) 
52 (3.9) 
49 (4.1 
56 (4.5) 
39 (0.3) 
72 (3.5 
59 (3.6 
84 (4.4) 


542 (5.9) 
542 (2.5) 
541 (5.2) 
465 (4.6) 
500 (3.7) 
611 (3.1) 
514 (2.6) 
495 (2.5) 
521 (2.6) 
397 (6.4) 
403 (7.2) 


| Affected ALot | ALot 


2 (1.5) 
0 (0.0) 
2 (13) 
0 (0.0) 
0 (0.1) 
5 (1.8) 
0 (0.0) 
17 (0.3) 
0 (0.0) 
16 (2.5) 
8 (3.6) 


608 (9.2) 


532 (6.1) 


392 (11.4) 
384 (38.5) 


Average 
Scale Score 


11.2 (0.18 
11.2 (0.13) 
11.0 (0.18 
11.0 (0.16 
10.9 (0.11 
10.6 (0.17 
10.8 (0.11 
10.2 (0.02) 
10.4 (0.10 
9.5 (0.16 
9.1 (0.20 


Significantly higher than 2011 © 
Significantly lower than 2011 @ 


How much is your school's capacity to provide instruction affected by a shortage or inadequacy of 


the following? 


A. General School Resources 


1) Instructional materials (e.g., textbooks) 


2) Supplies (e.g., papers, pencils, materials) 


3) School buildings and grounds 


4 


Heating/cooling and lighting systems: 


6) Technologically competent staff 


7) Audio-visual resources for delivery of instruction 
(e.g., interactive white boards, digital projectors) 


8) Computer technology for teaching and learning 


) 
) 
) 
5) Instructional space (e.g., classrooms) 
) 
) 


(e.g., computers or tablets for student use) 


B. Resources for Reading Instruction 


1) Teachers with a specialization in reading 


2) Computer software/applications for 


reading instruction 


3) Library resources (books, ebooks, 


Magazines, tC.) a O ——— O —— O — Cc 


4) Instructional materials for reading 


(e.g., reading series, textbooks) 
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Notat all 


Affected 
10.8 


Alittle 


Some 


Somewhat 
Affected 


Alot 


Difference in Average 
Scale Score from 


2011 


0.2 (0.23) 


0.3 (0.26) 


0.1 (0.19 
-0.2 (0.03 
-0.1 (0.16 
0.3 (0.29 


) 
) 
) 
) 


SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 


TIMSS & PIRLS 


Fg 
g IEA International Study Center 
= 


Lynch School of Education 
BOSTON COLLEGE 


186 
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Exhibit 5.5: Size of School Library 


Exhibit 5.5 presents principals’ reports about the existence and size of school libraries. Given that 
some countries have well-resourced classroom libraries rather than a larger central library, the 
results in Exhibit 5.5 should be considered in light of the information about classroom libraries 
found in Exhibit 9.4. Nearly one-third of the students (32%) were in schools where the library had 
more than 5,000 book titles and only 13 percent were in schools with no book titles. Average reading 
achievement in schools with the largest libraries was 525, compared to 494 to 501 for schools with 
a smaller or no central library. 
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Country 


Australia 

Austria 
Azerbaijan 
Bahrain 

Belgium (Flemish) 
Belgium (French) 
Bulgaria 

Canada 

Chile 

Chinese Taipei 
Czech Republic 
Denmark 

Egypt 

England 

Finland 

France 

Georgia 

Germany 

Hong Kong SAR 
Hungary 

Iran, Islamic Rep. of 
Ireland 

Israel 

Italy 

Kazakhstan 
Kuwait 

Latvia 

Lithuania 

Macao SAR 

Malta 

Morocco 
Netherlands 

New Zealand 
Northern Ireland 
Norway (5) 

Oman 

Poland 

Portugal 

Qatar 

Russian Federation 
Saudi Arabia 
Singapore 

Slovak Republic 
Slovenia 

South Africa 
Spain 

Sweden 

Trinidad and Tobago 
United Arab Emirates 
United States 


Exhibit 5.5: Size of School Library 


Students Categorized by Principals' Reports 
Does not include classroom libraries. For information about classroom libraries, see Exhibit 9.4 


More than 5,000 Book Titles 


Average 


Achievement 


Percent 
of Students 
57 


(3.7 544 (4.2) 
3 (13) 551 (9.1) 
40 (4.1 477 (6.4) 
47 (2.8) 465 (4.2) 
2 (1.1 ume 
3 (1.2 523 (16.8) 
33 (3.3) 572 (4.2) 
51 (2.6) 547 (2.5) 
18 (2.6 514 (6.0) 
93 (2.1 560 (2.0) 
7 (2.2 551 (5.0) 
59 (3.5) 550 (2.8) 
15 (2.9 358 (14.4) 
18 (3.2) 565 (5.7) 
3 (1.5) 573 (16.0) 
4 (1.8) 485 (8.4) 
42 (3.2) 490 (3.5) 
0 (0.0) oe 
91 (2.3) 569 (3.1) 
50 (4.0) 563 (4.1) 
1 (0.7) som 
9 (2.6) 564 (6.8) 
4 (1.7) 550 (24.6) 
4 (1.8) 559 (9.7 
71 (3.9 537 (3.1 
14 (3.4) 426 (16.6) 
55 (4.0) 562 (2.2) 
46 (3.6 548 (3.3 
87 (0.1 544 (1.1 
16 (0.1 446 (3.5) 
0 (0.0 hes 
2 (15 oe 
44 (3.5 528 (4.7 
3 (17 561 (6.4) 
25 (4.1) 560 (4.0) 
21 (2.1) 426 (6.9) 
73 (3.7) 565 (2.2) 
47 (4.1) 528 (2.9) 
58 (0.4) 443 (2.6) 
65 (3.5) 586 (3.2) 
1 (0.6) mone 
71 (0.0) 582 (3.6) 
11 (2.7) 533 (15.6) 
68 (3.7) 541 (1.6) 
6 (2.1) 393 (32.6) 
17 (2.1) 540 (3.0) 
29 (4.1) 558 (4.7) 
2 (1.2) a 
48 (2.0) 485 (5.5) 
52 (4.0) 556 (5.0) 
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501—5,000 Book Titles 


40 (3.7 546 (4.7) 
57 (4.0 542 (3.2) 
46 (4.4 475 (5.6) 
44 (2.9) 433 (3.3) 
19 (3.2 522 (5.2) 
23 (3.9) 506 (5.4) 
31 (3.8 548 (8.4) 
46 (2.5 540 (2.8) 
58 (4.2 492 (4.3) 
7 (2.1 549 (10.0) 
56 (4.3 541 (3.0) 
33 (4.0 546 (4.6) 
56 (4.7 338 (7.8) 
62 (3.7) 558 (2.6) 
40 (4.3) 567 (3.0) 
39 (4.2) 512 (4.1) 
47 (3.7) 488 (4.7) 
45 (3.6) 542 (3.3) 
9 (2.2) 570 (8.6) 
34 (4.0) 550 (7.1) 
31 (3.2) 471 (4.9) 
48 (4.5) 565 (3.2) 
48 (4.3) 533 (5.0) 
46 (4.1 551 (3.4) 
24 (3.9 534 (5.6) 
52 (6.1) 396 (8.4) 
36 (4.3 558 (3.8) 
45 (3.8 549 (4.6) 
12 (0.1 542 (2.7) 
62 (0.1 454 (2.0) 
9 (2.0 404 (12.5) 
48 (5.0) 543 (2.8) 
51 (3.5 527 (4.2) 
59 (5.0 562 (4.0) 
63 (4.7) 560 (2.9) 
63 (3.0) 419 (4.0) 
22 (3.5) 563 (6.6) 
40 (3.8) 525 (3.8) 
33 (0.4) 446 (3.3) 
32 (3.7) 575 (4.6) 
17 (2.5) 404 (11.2) 
29 (0.0) 562 (6.6) 
60 (3.8) 536 (3.7) 
22 (3.7) 550 (4.5) 
12 (2.3) 375 (17.0) 
67 (2.9) 528 (1.6) 
57 (4.6) 556 (3.0) 
32 (4.0) 480 (7.5) 
39 (2.3) 421 (4.7) 
43 (3.9) 543 (4.6) 


19 (3.0 540 (5.0 21 (3.2) 
14 (3.1 449 (17.0) 0 (0.0) 
8 (1.7 426 (8.6 1 (0.7 
28 (4.2 524 (4.1 50 (4.2 
38 (4.6 496 (3.9) 36 (4.0 
16 (3.0 540 (14.5) 20 (3.3 
2 (0.9 a 1 (0.6) 
22 (4.2 481 (6.2 3 (15 
0 (0.3 a ee 0 (0.0) 
13 (2.8) 541 (5.5 24 (3.6 
2 (1.0 oy 6 (2.0 
22 (3.5 307 (16.1) 7 (23 
13 (2.4) 556 (5.8) 8 (2.2) 
26 (3.8) 562 (4.5) 30 (3.4) 
31 (4.3) 507 (5.0) 25 (3.6) 
10 (2.2) 491 (9.3) 1 (0.7) 
27 (3.5) 526 (10.3) 28 (3.3) 
1 (0.7) rea 0 (0.0) 
1 (0.9) oy te 16 (3.1) 
43 (4.0) 417 (7.9) 24 (3.5) 
6 (2.2) 570 (5.8) 36 (4.5) 
30 (4.0) 528 (7.7) 17 (3.2 
33 (4.3) 548 (4.1) 17 (3.4) 
4 (1.6) 533 (11.1) 1 (0.6 
34 (5.5) 383 (9.8) 0 (0.0) 
8 (2.2) 531 (8.4) 1 (08 
8 (2.1) 548 (16.4) 1 (1.0) 
0 (0.0) Aum 1 (0.0) 
7 (0.1) 443 (7.0) 15 (0.1 
28 (3.0) 389 (9.6) 63 (3.0 
24 (4.5) 542 (4.3) 26 (4.6 
3 (1.4) 498 (30.8) 1 (0.9 
12 (3.1) 571 (9.3) 26 (4.6) 
7 (2.0) 553 (9.4) 4 (1.8) 
10 (2.1) 407 (13.8) 5 (1.5) 
1 (0.7) oie 4 (17) 
11 (1.4) 536 (6.8) 2 (1.6) 
7 (0.1) 426 (4.3) 2 (0.1) 
3 (1.0) 537 (13.0) 0 (0.2) 
51 (3.7) 438 (5.4) 31 (3.3) 
0 (0.0) os 0 (0.0) 
16 (2.4) 539 (8.4) 14 (2.9) 
9 (2.2) 534 (14.3) 0 (0.1) 
20 (3.3) 320 (11.8) 62 (3.6) 
13 (1.9) 518 (8.6) 4 (1.4) 
8 (2.7) 543 (10.1) 6 (1.8) 
45 (4.9) 492 (6.1) 21 (3.7) 
12 (1.7) 411 (10.6) 1 (0.4) 
3 (1.5) 561 (15.1) 3 (1.3) 


500 Book Titles or Fewer No School Library 


Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement 
2 (1.0 ~~ 1 (0.5 ~~ 


538 (6.1) 


528 (3.6) 
494 (4.7) 
531 (9.5) 


508 (13.4) 
547 (4.1) 
545 (8.6) 
316 (16.7) 
562 (7.1) 
568 (3.3) 
523 (4.4) 


537 (7.1) 
537 (8.2) 
387 (10.0) 
569 (5.8) 
520 (10.6) 
540 (6.9) 


456 (3.3) 
337 (5.1) 
553 (3.5) 
571 (6.1) 
549 (17.0) 
417 (11.0) 
589 (10.3) 


431 (9.2) 


525 (14.0) 
301 (5.1) 
505 (8.1) 
545 (10.3) 
472 (10.2) 


515 (14.8) 


International Avg. EP) OS) 512 (0.8) EXCE) 501 (1.6) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A tilde (~) indicates insufficient data to report achievement. 
An “r" indicates data are available for at least 70% but less than 85% of the students. 
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Exhibit 5.5: Size of School Library (Continued) 


Benchmarking Participants 


Buenos Aires, Argentina 27 (3.6) 
Ontario, Canada 49 (4.9) 
Quebec, Canada 35 (5.0) 
Denmark (3) 57 (3.6) 
Norway (4) 25 (4.1) 
Moscow City, Russian Fed. 88 (2.9) 
Eng/Afr/Zulu - RSA (5) r 15 (4.7) 
Andalusia, Spain 19 (3.0) 
Madrid, Spain 22 (3.3) 
Abu Dhabi, UAE 47 (3.9) 
Dubai, UAE 71 (0.3) 


Does your school have a school library? 


1) Yes 


481 (5.9) 
545 (4.0) 
552 (3.2) 
506 (4.3) 
520 (4.4) 
610 (2.3) 
444 (28.3) 
533 (5.1) 
547 (3.4) 
443 (8.9) 
535 (2.5) 


2)No 


=] 


If Yes, 


501-5,000 Book Titles 


53 (4.4) 
48 (4.5) 
57 (4.7) 
35 (4.0) 
64 (4.7) 
12 (2.8) 
15 (3.4) 
65 (3.8) 
67 (3.6) 
42 (4.3) 
25 (0.3) 


481 (5.7) 
542 (5.2) 
545 (4.0) 
495 (4.9) 
518 (2.6) 
625 (7.1) 
443 (17.4) 
523 (2.7) 
549 (2.7) 
394 (7.9) 
486 (3.2) 


11 (2.6) 
3 (1.8) 
3 (1.8) 
2 (0.9) 
7 (1.9) 
1 (0.8) 

25 (5.1) 

15 (2.9) 

11 (2.6) 

11 (2.7) 
3 (0.0) 


491 (8.1) 
530 (11.5) 
562 (24.6) 


510 (6.8) 
407 (13.1) 
524 (6.0) 
550 (5.3) 
384 (12.5) 
419 (8.6) 


Approximately how many books with different titles does your school library have (exclude 


magazines and periodicals)? 


1) 250 or fewer 
2) 251-500 

3) 501-2,000 
4) 2,001—5,000 
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More | Morethan5,000BookTites | 5,000 Book Titles 500 Book Titles or Fewer No School Library 
Country Percent [ieee Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement of Students Achievement 


8 (2.1) 502 (8.5) 
0 (0.1) oD 

4 (2.1) 547 (14.3) 
6 (2.0) 476 (12.2) 
4 (17) 516 (5.5) 
0 (0.0) oD 
45 (5.5) 391 (8.8) 
1 (1.0) on 

1 (0.8) mie 

0 (0.4) oe 

1 (0.0) tite 
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Exhibit 5.6: Schools with Computers Available for Instruction 
Exhibit 5.6 shows principals’ reports about the availability of computers for reading instruction. 
On average, the majority of the fourth grade students (51%) were in schools that had 1 computer 
for 1 to 2 students, 23 percent in schools with 1 computer for 3 to 5 students, 19 percent in schools 
with 1 computer for 6 or more students, and 7 percent in schools with no computers available for 
instruction. The relationship between computer availability and average reading achievement is 
difficult to interpret because it is highly interrelated with socioeconomic levels and instructional 
practices. In the primary grades, computer instruction often is used for remedial purposes. The 


results show that those students in schools with no computers had lower achievement than the 
students in schools with computer availability. 
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Exhibit 5.6: Schools with Computers Available for Instruction 


Students Categorized by Principals' Reports 


International Avg. OS) EW) 515 (2.1) CX) oe) 477 (3.3) 


Country 


Australia 
Austria 
Azerbaijan 

Bahrain 

Belgium (Flemish) 
Belgium (French) 
Bulgaria 

Canada 

Chile 

Chinese Taipei 
Czech Republic 
Denmark 

Egypt 

England 

Finland 

France 

Georgia 

Germany 

Hong Kong SAR 
Hungary 

Iran, Islamic Rep. of 
Ireland 

Israel 

Italy 

Kazakhstan 

Kuwait 

Latvia 

Lithuania 

Macao SAR 

Malta 

Morocco 
Netherlands 

New Zealand 
Northern Ireland 
Norway (5) 

Oman 

Poland 

Portugal 

Qatar 

Russian Federation 
Saudi Arabia 
Singapore 

Slovak Republic 
Slovenia 

South Africa 

Spain 

Sweden 

Trinidad and Tobago 
United Arab Emirates 
United States 


1-2 Students per Computer 


Percent 
of Students 


Average 


84 (2.9) 545 (3.1) 
18 (3.2) 541 (4.4) 
22 (3.4) 461 (8.1) 
42 (3.1) 451 (3.9) 
51 (3.6) 529 (2.5) 
34 (3.9) 496 (4.5) 
39 (3.4) 529 (6.4) 
85 (1.7) 543 (2.1) 
74 (4.1) 489 (3.3) 
38 (3.2) 554 (3.7) 
84 (3.1) 541 (2.4) 
90 (2.5) 548 (2.3) 
3 (1.5) 294 (72.8) 
86 (2.3) 559 (2.2) 
75 (3.5) 566 (2.1) 
40 (4.2) 514 (4.4) 
83 (3.1) 488 (3.2) 
35 (3.7) 535 (5.5) 
77 (4.2) 569 (3.5) 
46 (3.7) 535 (4.9) 
1 (0.7) piss 
57 (4.6) 569 (3.1) 
40 (3.8) 535 (6.2) 
20 (3.2) 554 (5.4) 
39 (3.7) 537 (4.1) 
34 (5.1) 386 (11.7) 
49 (3.6 546 (2.6) 
47 (3.7 540 (4.6) 
82 (0.1 547 (1.2) 
18 (0.1 452 (3.7) 
5 (1.3 458 (16.8) 
65 (4.7 547 (2.6) 
78 (3.7) 524 (3.4) 
82 (4.5 562 (3.1) 
79 (3.6) 558 (2.6) 
25 (2.2) 422 (8.9) 
68 (3.9) 563 (3.0) 
11 (1.9) 532 (6.4) 
52 (0.4) 431 (2.4) 
48 (3.3) 582 (4.3) 
12 (2.3) 435 (11.1) 
87 (0.0) 578 (3.4) 
88 (3.0) 535 (3.3) 
63 (4.2) 541 (2.6) 
11 (3.1) 365 (28.7) 
59 (3.0) 525 (2.5) 
84 (3.6) 555 (3.0) 
10 (2.4) 491 (10.3) 
38 (2.1) 452 (5.3) 
89 (2.7) 551 = 7 


3—5 Students per Computer 


Average 


Percent 
of Students Achievement 


Achievement 


13 (2.6) 544 (7.6) 
22 (3.8) 550 (4.5) 
35 (4.6) 469 (7.6) 
34 (2.6) 431 (4.2) 
36 (3.9) 527 (4.1) 
36 (4.8) 500 (4.4) 
37 (3.7) 568 (6.4) 
13 (1.5) 548 (4.3) 
20 (4.1) 508 (7.3) 
39 (3.7) 560 (3.0) 
12 (2.8) 550 (4.7) 

8 (2.1) 554 (10.7) 

6 (2.1) 421 (17.3) 
10 (1.7) 561 (6.9) 
h (2.9) 565 (4.8) 

41 (4.3) 512 (3.7) 
11 (2.7) 483 (8.3) 
38 (4.0) 541 (3.7) 
20 (4.1) 571 (5.3) 
26 (3.6) 572 (5.7) 

3 (1.1) 385 (86.8) 
19 (3.6) 561 (6.7) 
41 (4.1) 536 (6.5) 
37 (4.1) 548 (4.2) 
19 (3.3) 530 (6.3) 
35 (4.0) 382 (7.1) 
29 (4.6) 569 (3.4) 
25 (3.5) 548 (4.9) 
14 (0.1) 526 (3.5) 
67 (0.1) 451 (2.1) 

6 (1.3) 422 (14.5) 
17 (3.6) 544 (8.2) 
20 (3.4) 531 (5.8) 
10 (3.4) 574 (12.8) 
16 (3.5) 565 (5.7) 
20 (2.5) 420 (5.6) 
26 (3.7) 571 (3.5) 
31 (4.2) 532 (3.2) 
24 (0.3) 445 (4.9) 
31 (2.7) 586 (4.0) 
10 (2.6) 430 (13.8) 
11 (0.0) 558 (11.7) 
10 (2.7) 539 (17.9) 
29 (3.8) 546 (3.6) 
19 (2.9) 375 (14.3) 
26 (2.9) 532 (3.0) 
13 (3.4) 554 (5.6) 
25 (4.0) 491 (9.0) 
35 (2.5) 436 (6.1) 

9 (2.5) 538 (15.4) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A tilde (~) indicates insufficient data to report achievement. 


An 


en 


r” indicates data are available for at least 70% but less than 85% of the students. An “s 
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ugh 


6 or More Students per Computer 


Percent Average Percent Average 
of Students Achievement of Students Achievement 


5 on 
31 (3.8 
24 (2.0 
12 (2.9 
16 (3.3 
21 (3.2 


13 (2.7 
5 (1.8 

26 (3.3 
2 (1.2 

17 (3.1 
44 (3.9 
24 (4.2 
14 (2.9 
39 (3.8 
33 (3.7 
26 (4.8) 
20 (3.4) 
26 (3.8) 
0 (0.0) 

4 (0.1) 

22 (3.1) 
7 (3.5) 
2 (1.2) 
8 (3.6) 
4 (1.6) 
50 (2.9) 
6 (2.0) 

55 (4.1) 
23 (0.4) 
19 (2.8) 
45 (3.3) 
2 (0.0) 

2 (13) 

7 (2.6) 

a (2.6) 
11 (1.8) 

3 (1.5) 

20 (3.6) 
27 (2.3) 
2 (1.1) 


539 (4.5) 
536 (3.4) i i 7 
496 (4.4) 12 (2.9) 
460 (7.2) 0 (0.2) 
506 (6.7) 0 (0.0) 
506 (9.4) 15 (3.2) 
551 (11.8) 4 (1.6) 
ay 0 (0.0) 
494 (13.3) 1 (0.9) 
565 (3.1) 1 (1.0) 
566 (9.1) 1 (0.8) 
me 1 (0.5) 
322 (6.4) 7 (2.5) 
564 (11.0) 0 (0.5) 
567 (7.5) 0 (0.0) 
502 (5.6) 6 (1.9) 
521 (9.6) 1 (0.7) 
537 (10.1) 1 (0.7) 
ae 1 (0.8) 
569 (6.8) 11 (3.0) 
445 (5.9) 52 (3.8) 
565 (5.9) 0 (0.0) 
515 (13.0) 6 (2.1) 
545 (3.5) 4 (1.7) 
540 (5.6) 9 (2.5) 
397 (9.8) 6 (3.0) 
566 (5.0) 3 (1.5) 
560 (4.8) 2 (1.2) 
ees 4 (0.0) 
455 (3.1) 1 (0.0) 
374 (10.0) 67 (2.9) 
543 (5.7) 1 (0.8) 
aba 0 (0.0) 
582 (7.9) 0 (0.0) 
555 (8.1) 1 (0.7) 
425 (4.5) 5 (1.5) 
581 (11.0) 0 (0.0) 
523 (3.8) 3 (1.3) 
479 (4.3) 0 (0.0) 
571 (5.7) 2 (0.9) 
423 (6.8) 33 (3.4) 
Dm 0 (0.0) 
cic 0 (0.1) 
537 (6.6) 1 (0.8) 
306 (17.1) 57 (4.3) 
525 (5.4) 4 (1.4) 
544 (10.5) 0 (0.0) 
507 (8.9) 46 (4.1) 
471 ane 2) 1 (0.0) 
: e “ 


No Computers Available 


422 (19.5) 


489 (7.6) 
574 (10.2) 


355 (28.7) 
508 (7.7) 


561 (9.9) 
416 (6.3) 
506 (21.3) 
554 (8.7) 
518 (10.1) 
434 (39.2) 
573 (18.1) 


582 (2.9) 


339 (5.1) 


399 (6.5) 


552 (7.7) 


305 (6.0) 
528 (8.8) 


470 (6.1) 


indicates data are available for at least 50% but less than 70% of the students. 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


TIMSS & PIRLS 
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Exhibit 5.6: Schools with Computers Available for Instruction (Continued) 


Benchmarking Participants 


Buenos Aires, Argentina 
Ontario, Canada 

Quebec, Canada 

Denmark (3) 

Norway (4) 

Moscow City, Russian Fed. 
Eng/Afr/Zulu - RSA (5) 5 
Andalusia, Spain 

Madrid, Spain 

Abu Dhabi, UAE 

Dubai, UAE 


1-2 } 1-2Studens perComputer | per } 1-2Studens perComputer | 


Percent Average Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement of Students Achievement 


59 (4.2 
89 (3.3 
67 (5.0 
86 (3.0 
74 (3.9 
78 (3.7 
11 (3.3) 
55 (4.2) 
37 (3.6) 
47 (3.7) 
44 (0.3) 


) 
) 
) 
) 
) 
) 


Downloaded from http://pirls2016.org/download-center/ 


474 (4.8) 
546 (3.5) 
549 (4.4) 
501 (3.0) 
517 (2.2) 
611 (2.4) 
451 (29.3) 
522 (3.2) 
550 (4.1) 
417 (8.8) 
515 (2.4) 


3—5 Students per Computer 


27 (3.8) 

9 (3.1) 
27 (4.3) 
11 (2.5) 
20 (3.4) 
19 (3.5) 
32 (5.3) 
20 (3.8) 
48 (3.5) 
36 (3.8) 
26 (0.3) 


School Student-to- 
Computer Ratio 


490 (7.3) 
543 (10.5) 
548 (5.0) 
504 (9.8) 
520 (5.3) 
613 (4.5) 
437 (14.4) 
531 (5.1) 
550 (2.9) 
409 (9.6) 
503 (3.6) 


6 or More Students per Computer No Computers Available 


14 (3.0 
2 (1.2 
6 (2.4 
3 (1.8 
6 (2.1 
3 (1.5 

14 (3.2) 

14 (3.3) 

15 (2.5) 

16 (2.6) 

30 (0.2) 


) 
) 
) 
) 
) 
) 


School Enrollment of 
Fourth Grade Students 


Number of Computers or 
Tablets Available for Use 
by Fourth Grade Students 


496 (13.5) 
538 (10.5) 
501 (20.1) 
515 (7.3) 
607 (16.6) 
363 (19.0) 
526 (5.2) 
544 (4.1) 
419 (14.8) 
533 (4.3) 


ZF 
iF 


0 (0.0) a 

0 (0.0) ay 

0 (0.0) ai 

1 (0.5) ae 

1 (0.7) ~~ 

0 (0.0) 2 
43 (5.5) 400 (11.9) 
10 (2.5) 524 (5.3) 
1 (0.7) ~~ 

2 (0.1) 2 

0 (0.0) ~~ 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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SGHUUL GLIMAVE 


“IRLS ZU10 INTERNATIONAL RESULIS 
N READING 


eS TIMSS Fou 
Z IEA | Lynch School o cation 


BOSTON COLLEGE 


READING-FOURTH GRADE PRLS 
VAS 
Schools Have Positive Environments 


Generally, fourth grade students were in positive school environments, according to 
their parents, principals, teachers, and the students themselves. 


The majority of PARENTS are very satisfied with the 
performance of their child’s school 


Less than 
5 % Satisfied 


Very 
Satisfied 
Somewhat 
Satisfied 


PRINCIPALS and TEACHERS agree that the schools 


Very High O 
Emphasis 8 Yo 
52 


emphasize academic success 


Very High O 
Emphasis 8 Yo Medium 
Emphasis 


3/% 


Medium 
Emphasis 

0 

- 8 Yo Average 
Achievement 


497 


Average 
Achievement 


518 


Average 
0 Achievement 
‘ A Yo 518 

High 
Emphasis 


Se 


High 
Emphasis 


Percent 
of students 


O/, High Sense of 
518 59 Yo School Belonging 


505 3 3% Some Sense of 


School Belonging 


Almost all FOURTH GRADE 
STUDENTS reported a 
positive sense of school 
belonging, and a higher 
sense of school belonging 
was related to higher average 
reading achievement. 


Average Achievement 


0/,, Little Sense of 
495 8 Yo School Belonging 


SOURCE: IEA's Progress in International Reading 
Literacy Study — PIRLS 2016 


http://pirls2016.0rg/download-center/ 
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CHAPTER 6 


School Climate 


Exhibit 6.1: Parents’ Perceptions of Their Child’s School 

Exhibit 6.1 shows that parents reported positive perceptions about their children’s school. Nearly 
two-thirds of the fourth grade students (65%) had parents who were Very Satisfied and another 
30 percent had parents who were Somewhat Satisfied. Those students had higher average reading 
achievement (515 and 509) than the 5 percent of students whose parents were Less than Satisfied 


(500). 
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Exhibit 6.1: Parents’ Perceptions of Their Child's School 


Students Categorized by Parents’ Reports 

Students were scored on the Parents’ Perceptions of their Child's School scale according to their parents’ responses to six statements 
about the school. Students whose parents are Very Satisfied had a score on the scale of at least 9.5, which corresponds to their 
parents “agreeing a lot” with three of the six statements and “agreeing a little” with the other three, on average. Students whose 
parents are Less than Satisfied had a score no higher than 6.3, which corresponds to their parents “disagreeing a little” with three 
of the six statements and “agreeing a little” with the other three, on average. All other students had parents who were Somewhat 
Satisfied. 


Very Satisfied Somewhat Satisfied SSUETT US 
Country Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of sts Achievement 


Average 


Scale Score 


SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 


Malta 92 (0.6) 460 (1.7) 7 (0.5) 444 (6.1) 114 (0.02) 
Kazakhstan 91 (0.6) 536 (2.5) 8 (0.6) 543 (4.9) 5 a ~~ 114 (0.04) 
Georgia 88 (1.0) 491 (2.9) 11 (0.9) 484 (5.2) 1 (0.2) ~~ 11.2 (0.05 
South Africa s 82 (1.0) 337 (5.4) 15 (0.9) 304 (7.5) 2 (0.3) = 11.0 (0.05 
Ireland 82 (1.0) 572 (2.5) 16 (0.9) 568 (4.4) 2 (0.3) ~~ 10.9 (0.05 
Trinidad and Tobago r 80 (1.3) 491 (3.6) 16 (1.1) 469 (6.0) 3 (0.4) 447 (12.3) 10.8 (0.06 
Azerbaijan 79 (1.3) 477 (3.7) 19 (1.1) 462 (7.7) 3 (0.4) 439 (14.5) 10.6 (0.06) 
Saudi Arabia 78 (1.1) 439 (4.2) 19 (0.9) 411 (6.3) 4 (0.4) 402 (9.2) 10.6 (0.05) 
Oman 76 (0.9) 426 (3.3) 21 (0.7) 407 (4.6) 3 (0.3) 360 (9.2) 10.5 (0.04 
Portugal 76 (1.0) 530 (2.7) 21 (0.9) 526 (2.8) 3 (0.3) 523 (8.3) 10.5 (0.05 
Bulgaria 76 (1.3) 551 (4.4) 21 (1.1) 562 (5.7) 3 (0.4) 556 (16.1) 10.5 (0.06) 
Egypt 74 (1.8) 336 (6.2) 21 (1.5) 314 (7.7) 5 (0.6) 325 (12.7) 10.4 (0.09) 
Spain 73 (1.1) 531 (1.6) 23 (0.9) 527 (3.7) 4 (0.3) 530 (5.4) 10.4 (0.05 
Macao SAR 71 (0.7) 550 (1.3) 26 (0.7) 536 (2.0) 3 (0.3) 519 (6.1) 10.3 (0.03 
Iran, Islamic Rep. of 71 (1.0) 426 (3.9) 25 (0.8) 435 (6.0) 4 (0.4) 427 (9.7) 10.1 (0.05) 
Qatar 71 (0.8) 459 (2.0) 24 (0.8) 438 (4.2) 5 (0.3) 404 (6.8) 10.3 (0.03) 
Chile 70 (1.5) 497 (2.8) 24 (1.1) 496 (3.7) 6 (0.6) 488 (10.1) 10.2 (0.08) 
Lithuania 67 (1.4) 550 (3.2) 29 (1.2) 550 (3.4) 4 (0.4) 538 (7.0) 10.0 (0.05) 
Slovak Republic 67 (1.3) 533 (3.9) 29 (1.0) 544 (4.9) 4 (0.5) 533 (9.4) 10.1 (0.06) 
Israel 66 (1.2) 529 (2.8) 27 (0.9) 547 (4.0) 8 (0.7) 550 (6.0) 10.0 (0.06) 
Italy 66 (1.2 552 (2.5) 30 (1.0 551 (3.0) 4 (0.4) 536 (5.7 5 0 (0.05) 
Morocco 65 (1.6 376 (4.0 28 (1.4 337 (4.8 6 (0.7 310 (9.4 .8 (0.07) 
Hong Kong SAR 65 (1.2 573 (2.7 31 (1.0 563 (3.5 4 (0.4) 545 (8.1 7 (0.05) 
Bahrain 65 (1.2 461 (2.6 30 (0.9 430 (3.3 5 (0.4) 397 (7.3 10.0 (0.05) 
Singapore 64 (0.7 582 (3.2 33 (0.7 572 (3.4) 4 (03 565 (6.4) 10.0 (0.03) 
Canada r 63 (0.8 550 (1.9 32 (0.7 551 (2.4) 5 (0.4 536 (7.2 10.0 (0.04) 
Russian Federation 63 (1.1 580 (2.6 34 (0.9 583 (2.5 4 (0.4) 574 (6.2 10.0 (0.05) 
United Arab Emirates 62 (0.7 469 (3.7 32 (0.6) 436 (3.6 6 (0.3) 412 (6.0) 10.0 (0.03) 
Norway (5) 61 (1.4 563 (2.5 34 (1.2 557 (2.6 4 (0.4) 538 (7.0 9.9 (0.07) 
Kuwait r 61 (1.1 408 (4.3 30 (1.0 394 (5.3 9 (0.6 367 (8.5 9.7 (0.06 
Austria 60 (1.3) 541 (2.9) 33 (1.1) 547 (3.0) 7 (0.6) 538 (3.8) 9.8 (0.06 
Netherlands s 58 (2.2) 556 (2.9) 36 (1.9) 548 (2.9) 6 (0.6) 543 (5.8) 9.5 (0.08 
Hungary 57 (1.2 555 (3.3 36 (1.0 556 (3.3 7 (0.6 560 (5.8 9.7 (0.06 
Finland 55 (1.2 569 (2.2 42 (1.1 570 (2.4 4 (0.4 560 (6.0 9.5 (0.04) 
Poland 54 (1.3) 562 (2.3) 42 (1.2) 570 (3.2) 4 (0.4) 564 (7.1) 9.7 (0.05 
Belgium (Flemish) 52 (1.0) 525 (2.3) 43 (0.9) 532 (2.1) 5 (0.4) 521 (4.8) 9.5 (0.04) 
Denmark 51 (1.6) 553 (3.0) 36 (1.2) 550 (2.7) 13 (1.0) 537 (4.6) 9.2 (0.08 
Chinese Taipei 51 (1.1) 557 (2.9) 42 (1.0) 561 (2.2) 7 (0.4) 567 (3.7) 9.4 (0.04) 
Latvia 51 (1.5) 557 (2.4) 42 (1.2) 562 (2.3) 7 (0.6) 552 (4.6) 9.4 (0.07) 
Germany r 48 (1.3) 551 (3.3) 41 (1.1) 549 (3.8) 11 (0.9) 526 (6.5) 9.2 (0.06) 
Belgium (French) 47 (1.2) 498 (3.1) 44 (1.0) 504 (2.9) 9 (0.7) 488 (5.0) 9.2 (0.06 
Sweden 45 (1.5) 562 (3.1) 45 (1.1) 560 (2.6) 10 (0.8) 544 (5.3) 9.1 (0.08 
France 43 (1.1) 513 (2.5) 50 (1.0) 516 (2.8) 8 (0.5) 509 (6.8) 9.1 (0.05) 
Czech Republic 40 (1.3) 538 (3.0) 49 (1.1) 549 (2.2) 10 (0.6) 552 (4.1) 8.9 (0.05) 
Slovenia 32 (1.1) 536 (2.9) 60 (1.0) 549 (2.4) 7 (0.6) 546 (7.5) 8.7 (0.05) 
England -- -- -- -- -- -- -- 

United States -- -- -- -- -- -- -- 

Northern Ireland Xx 86 (1.2) 589 (3.5) 13 (1.1) 583 (6.7) 2 (0.4) = 11.2 (0.06) 
New Zealand Xx 71 (1.2) 545 (3.1) 24 (0.9) 536 (4.5) 5 (0.6) 539 (8.1) 10.3 (0.06) 
Australia Xx 64 (1.3) 565 (3.3) 30 (1.2) 563 (3.6) 6 (0.6) 553 (10.9) 10.0 (0.06) 


International Avg. EW) 30 (0.1) 509 (0.6) Ey) 


This PIRLS questionnaire scale was established in 2016 based on the combined response distribution of all countries that participated in PIRLS 2016. To provide a 
point of reference for country comparisons, the scale centerpoint of 10 was located at the mean of the combined distribution. The units of the scale were chosen 
so that 2 scale score points corresponded to the standard deviation of the distribution. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A dash (-) indicates comparable data not available. A tilde (~) indicates insufficient data to report achievement. 
An “r" indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are available for at least 50% but less than 70% of the students. 


sd TIMSS & PIRLS 


An “x" indicates data are available for less than 50% of the students—interpret with caution. 
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Exhibit 6.1: Parents’ Perceptions of Their Child's School (Continued) 


Country 


Benchmarking Participants 


Eng/Afr/Zulu - RSA (5) 
Buenos Aires, Argentina 
Andalusia, Spain 
Madrid, Spain 

Dubai, UAE 

Norway (4) 

Ontario, Canada 

Abu Dhabi, UAE 
Quebec, Canada 
Denmark (3) 


Moscow City, Russian Fed. 


What do you think of your child’s school? 


Ss 
Ss 


Very Satisfied 


Percent Average Percent Average Percent Average Scale Score 
of Students Achievement of Students Achievement of Students Achievement 


54 (1.2) 


424 (6.8) 
489 (3.2) 
527 (2.3) 
552 (2.5) 
530 (2.2) 
518 (2.4) 
552 (3.6) 
437 (5.4) 
548 (3.6) 
506 (3.3) 
611 (2.4) 


My child's school does a good job including me 


in my child’s education 


My child's school provides a safe environment 


My child's school cares about my child's progress 


in school 


My child’s school does a good job informing 
me of his/her progress 


My child's school promotes high 
academic standards 


6) My child's school does a good job in helping 


him/her become better in reading 


Downloaded from http://pirls2016.org/download-center/ 


Some’ 


42 (1.1) 


Agree alot 


Very 
Satisfied 


OV) 


what Satisfied 


392 (11.2) 
493 (5.5) 
531 (2.7) 
550 (2.9) 
502 (2.9) 
519 (2.7) 
550 (4.4) 
405 (5.3) 
555 (2.9) 
501 (3.8) 
613 (2.4) 


1 


Agree a little Disagree 
a little 


Somewhat | Less than 
Satisfied Satisfied 


63 


Less than Satisfied 


3 (0.4) 
2 (0.3) 
4 (0.4) 
4 (0.4) 
5 (0.3) 
4 (0.4) 

7 (0.7) 
7 (0.6) 
3 (0.5) 
1 (0.9) 
4 (0.4) 


Disagree 
alot 


385 (23.0) 11.0 (0.07) 

oo 10.9 (0.06) 
530 (7.1) 10.5 (0.06) 
544 (6.2) 10.3 (0.06) 
472 (7.0) 10.1 (0.03) 
512 (8.5) 10.0 (0.07) 
546 (7.5) 9.9 (0.07) 
387 (9.6) 9.8 (0.05) 
535 (7.4) 9.7 (0.05) 
486 (5.8) 9.5 (0.08) 
611 (5.7) 9.6 (0.05) 


ZF 
iF 


Average 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 6.2 and 6.3: School Emphasis on Academic Success 
The School Emphasis on Academic Success scale was administered to both principals and teachers. 
Exhibit 6.2 presents the results based on the principals and Exhibit 6.3 the results based on the 
teachers. On average, 8 percent of the fourth grade students attended schools where the principal 
reported a Very High Emphasis on academic success, 54 percent schools with High Emphasis, and 
38 percent schools with Medium Emphasis, with higher emphasis on academic success related to 
higher average reading achievement (531, 518, and 494, respectively). 

The results based on teacher reports were nearly identical. On average, according to the 

teachers, 8 percent of the students attended schools with a Very High Emphasis on academic 
success, 55 percent schools with High Emphasis, and 37 percent schools with Medium Emphasis. 


As would be anticipated, higher average reading achievement also was associated with teachers’ 
reports of higher emphasis on academic success (522, 518, and 497, respectively). 
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Exhibit 6.2: School Emphasis on Academic Success — Principals’ Reports 


Students Categorized by Principals' Reports 


Students were scored according to their principals’ responses characterizing twelve aspects on the School Emphasis on Academic 
Success scale. Students in schools where their principals reported a Very High Emphasis on academic success had a score on the 
scale of at least 12.9, which corresponds to their principals characterizing six of the twelve aspects as “very high” and the other six 
as “high,” on average. Students in schools with a Medium Emphasis on academic success had a score no higher than 9.2, which 
corresponds to their principals characterizing six of the twelve aspects as “medium” and the other six as “high,” on average. All 


other students attended schools with a High Emphasis on academic success. 


Very High Emphasis 


Country 


United Arab Emirates 

Qatar . a 
England 24 (3.3) 
Northern Ireland r 23 (3.7) 
Ireland 23 (3.0) 
Bahrain 19 (1.7) 
New Zealand 17 (3.1) 
Saudi Arabia 16 (2.7) 
Sweden 15 (3.5) 
Australia 14 (2.3) 
Oman 14 (1.9) 
Iran, Islamic Rep. of 13°(2:7) 
Singapore 12 (0.0) 
Kuwait 11:23) 
United States (1.9) 
Kazakhstan ( 
Israel 10 (2.5 
Malta 9 (0.1 
Lithuania 8 (2.2 
Chinese Taipei 8 (2.1 
Canada 8 (1.0 
Austria 7 (1.9 
Denmark 6 (1.8 
Spain 6 (1.1) 
Poland 6 (2.0) 
South Africa r 5 (1.8) 
Egypt 5 (1.7) 
Finland 4 (1.7) 
France 4 (1.7) 
Bulgaria 4 (1.7) 
Azerbaijan 4 (1.7) 
Hungary 3 (1.6) 
Latvia 3 (1.4) 
Portugal 313) 
Chile 3 (1.2) 
Slovenia 2 (1.6) 
Italy 2 (0.8) 
Russian Federation 2 (1.0) 
Hong Kong SAR 2 (1.2) 
Morocco 2 (1.0) 
Trinidad and Tobago 2 (1.4) 
Norway (5) 2 (1.1) 
Georgia 2 (1.0) 
Netherlands 2 (1.2) 
Belgium (Flemish) 2 (0.9) 
Germany 2 (1.1) 
Belgium (French) 1 (0.8) 
Czech Republic 1 (0.9) 
Slovak Republic 1 (0.7) 
Macao SAR : e 0) 


504 (7.3) 
468 (2.4) 
572 (4.4) 
571 (5.3) 
580 (3.6) 
488 (5.1) 
547 (5.1) 
468 (8.9) 
571 (5.1) 
567 (6.0) 
444 (9.6) 
458 (11.4) 
615 (8.8) 
433 (12.7) 
574 (8.4) 
537 (8.8) 
536 (12.6) 
462 (5.1) 
584 (3.8) 
575 (5.7) 
564 (4.8) 
569 (6.1) 
568 (6.2) 
557 (4.8) 
583 (15.0) 
396 (26.6) 
378 (9.7) 
592 (8.2) 
523 (12.3) 
596 (11.7) 
461 (36.1) 
621 (6.7) 
548 (11.9) 
562 (6.9) 
529 (17.0) 


High Emphasis 


50 (2.5) 
62 (0.3 
62 (4.1 
67 (4.8 
66 (4.0 
55 (2.8 


) 
) 
) 
) 
) 


66 (3.9) 
54 (3.9) 


47 (4.1 


) 


49 (3.8) 
69 (2.6) 
58 (3.8) 
59 (0.0) 
3.7) 
4.2) 


( 

( 
76 (3.2 
70 (3.9 

( 

( 


69 (4.0 
63 (2.9 
66 (3.9 
50 (3.6 
61 (2.6 
58 (4.2 
37 (3.7 
50 (4.2 
69 (4.2 
61 (4.0 
49 (4.3 
48 (4.0 
44 (3.9 
64 (4.1 
- (3.8 


26 (3. 

44 (4.5 
39 (3.9 
48 (3.8 
56 (4.0 
17 (1.9 
32 (3.9 
56 (4.5 
46 (3.6 
46 (4.6 
62 (3.8 
62 (3.5, 
51 (4.3 
35 (3.8 
33 (3.7 
63 (0.1 


) 
) 
) 
) 
) 
) 
) 
) 
) 


) 
) 
9) 
) 
) 
) 
) 
) 
) 
) 
) 
) 


Average 


Percent Average Percent 
of a Achievement of Students 


Achievement 
437 (4.2) 
439 (2.6) 
559 (3.0) 
565 (3.5) 
569 (2.9) 
447 (3.1) 
528 (3.2) 
438 (5.9) 
561 (3.8) 
556 (3.8) 
421 (3.7) 
435 (4.6) 
576 (3.7) 
409 (6.2) 
555 (4.4) 
538 (3.0 
538 (4.0 
453 (2.1 
552 (3.1 
561 (2.1 
551 (2.5 
547 (2.5 
551 (3.2 
531 (1.6) 
570 (2.6) 
311 (8.4) 
344 (10.0) 
566 (2.4) 
513 (3.0 
572 (4.3 
481 (7.0 
564 (5.1 
565 (2.3 
534 (3.8 
515 (6.1) 
547 (3.7) 
552 (3.5) 
594 (3.8) 
571 (3.7) 
429 (7.0) 
513 (5.4) 
566 (2.8) 
492 (4.6) 
552 (2.9) 
532 (2.5 
552 (3.0 
512 (3.1 
550 (3.2 
556 (4.4 
553 (1.3 


Medium Emphasis 


Average 


Percent 
of Students 


Achievement 


Average 


Scale Score 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


22 (1.8) 412 (6.8) 11.3 (0.07) 
13 (0.2) 405 (3.9) 11.6 (0.01) 
15 (2.5) 535 (4.9) 11.3 (0.15) 

9 (3.1) 547 (12.4) 11,7 (0.17) 
12 (2.9) 527 (5.9) 11.4 (0.17) 
26 (2.5) 414 (5.5) 10.8 (0.11) 
17 (2.8) 491 (9.5) 11.2 (0.14) 
30 (3.2) 397 (8.6) 10.5 (0.17) 
38 (4.0) 541 (3.2) 10.3 (0.20) 
36 (2.9) 519 (4.4) 10.4 (0.15) 
17 (2.1) 388 (8.5) 10.9 (0.10) 
29 (3.3) 400 (10.8) 10.4 (0.18) 
30 (0.0) 560 (6.7) 0.4 (0.00) 
35 (3.3) 359 (6.5) 0.2 (0.16) 
36 (4.1) 533 (5.1) 0.1 (0.17) 
14 (2.7 524 (8.2 1.0 (0.14) 
20 (3.5 499 (9.5 0.6 (0.14) 
30 (0.1 447 (2.6 0.4 (0.01) 
21 (3.1 522 (6.7 0.5 (0.12) 
24 (3.4 546 (4.5 10.6 (0.14) 
30 (2.7 523 (3.1 10.3 (0.09) 
28 (3.8 519 (5.1 10.3 (0.12) 
43 (3.7 539 (3.2 9.8 (0.13) 
33 (2.2) 516 (3.8) 10.1 (0.08) 
36 (3.7) 554 (3.9) 9.9 (0.12 
58 (3.7) 319 (6.0) 9.2 (0.17 
45 (4.2) 310 (8.1) 9.5 (0.18) 
26 (3.9) 562 (4.4) 10.2 (0.13) 
35 (3.5) 508 (4.9) 10.0 (0.13 
47 (4.1) 526 (6.4) 9.5 (0.14) 
48 (4.1) 464 (5.5) 9.5 (0.15 
53 (3.6) 540 (3.9) 9.2 (0.11 
33 (4.0) 546 (3.3) 10.0 (0.11) 
a (3.6) 520 (3.3) 9.3 (0.10 

71 (3.9) 485 (3.3) 8.0 (0.19) 
53 (4.5) 538 (2.4) ‘i 4 (0.13) 
58 (3.8) 547 (3.0) .1 (0.11) 
49 (3.6) 568 (3.9) 5 (0.10) 
42 (3.9) 566 (4.7) : 6 (0.11) 
81 (2.0) 341 (4.3) 8.0 (0.11) 
66 (3.9) 469 (4.2) 8.7 (0.15) 
42 (4.4) 548 (3.2) 9.6 (0.14) 
52 (3.6) 485 (3.5) 9.4 (0.11) 
52 (4.6) 540 (2.7) 9.3 (0.12) 
36 (3.7) 515 (3.7) 9.7 (0.11) 
37 (3.3) 509 (7.9) 9.7 (0.09) 
48 (4.1) 483 (3.9) 9.3 (0.11) 
64 (3.9) 540 (2.7) 8.9 (0.12) 
66 (3.8) 524 (4.7) 8.9 (0.09) 
37 (0.1) 533 (1.6) 9.6 (0.00) 


International Avg. 531 (1.9) 54 (0.5) 518 (0.6) 38 (0.5) 494 (0.8) 


This PIRLS questionnaire scale was established in 2016 based on the combined response distribution of all countries that participated in PIRLS 2016. To provide a point of 
reference for country comparisons, the scale centerpoint of 10 was located at the mean of the combined distribution. The units of the scale were chosen so that 2 scale score 
points corresponded to the standard deviation of the distribution. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A tilde (~) indicates insufficient data to report achievement. 
An “r" indicates data are available for at least 70% but less than 85% of the students. 
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Exhibit 6.2: School Emphasis on Academic Success — Principals’ Reports 
(Continued) 


Very High Emphasis High Emphasis 


Country Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement 


Benchmarking Participants 


Medium Emphasis 


Dubai, UAE 47 (0.3) 541 (3.0) 39 (0.3) 501 (2.5) 15 (0.2) 471 (3.8) 
Abu Dhabi, UAE 12 (2.2) 491 (13.1) 58 (4.1) 411 (6.2) 30 (3.8) 392 (10.4) 
Madrid, Spain 11 (2.1) 574 (8.2) 57 (4.3) 552 (2.0) 31 (3.8) 533 (3.0) 
Ontario, Canada 8 (1.3) 562 (7.9) 63 (4.8) 551 (4.1) 29 (4.6) 524 (5.3) 
Denmark (3) 6 (1.6) 509 (10.6) 50 (3.8) 507 (3.8) 44 (4.1) 491 (4.4) 
Andalusia, Spain 6 (1.9) 549 (6.5) 61 (3.9) 530 (2.4) 33 (3.9) 512 (4.7) 
Buenos Aires, Argentina 5 (1.9) 467 (19.8) 47 (3.5) 503 (4.4) 48 (3.5) 461 (5.4) 
Eng/Afr/Zulu - RSA (5) r 4 (2.3) 440 (60.9) 35 (5.7) 429 (12.7) 60 (5.7) 396 (9.0) 
Quebec, Canada 3 (1.5) 555 (15.6) 68 (4.7) 554 (3.3) 29 (4.9) 532 (6.1) 
Norway (4) 2 (1.3) = oe 58 (4.3) 522 (2.7) 40 (4.2) 510 (2.6) 
Moscow City, Russian Fed. 2 (1.1) ~~ 69 (4.0) 616 (2.6) 29 (3.8) 601 (3.6) 


How would you characterize each of the following within your school? 


Very high High Medium 


Teachers’ understanding of the school’s | | 
Teachers’ degree of success in implementing 
Teachers’ expectations for student 


Collaboration between school leadership 
(including master teachers) and 


Parental commitment to ensure that 


Very low 


! 


curricular goals O—— (7) (7) ss () ss (>) 


the school's curriculum OC — (~) es (7) es (~) ses () 


achievement 0 — 0 — OO  ——O——O 


Teachers’ ability to inspire students OC — (~) os (~) os (~) ss () 


teachers to plan instruction O——— (7) es (~) se (ss (~) 
Parental involvement in school activities CO — (CT) es (7) es (”) se (”) 


students are ready to learn OC —e (C) es (~) es (sees (~) 


Parental expectations for 


student achievement O—— (—) a (~) ss (>) (~) 
Parental support for student achievement ~~~ (_) == (_) se) ms (es (+) 
10) Students’ desire to do well in school CO —— (~) es (~) es (~) ss (~) 


11) Students’ ability to reach 


school’s academic goals OC ——e () as (~) es (>) (~) 


12) Students’ respect for classmates 


who excel academically Q eC) es (7) as (en (”) 


ee 
Very High I High i Medium Emphasis 


Emphasis Emphasis 
12.9 9.2 
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Average 


Scale Score 


12.2 (0.01) 
10.5 (0.14) 
10.3 (0.15) 
10.3 (0.15) 
9.8 (0.14) 
10.0 (0.14) 
9.5 (0.15) 
9.3 (0.27) 
10.2 (0.21) 
9.6 (0.13) 
9.9 (0.10) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 6.3: School Emphasis on Academic Success — Teachers’ Reports PAV EP crace 


Students Categorized by Teachers' Reports 


Students were scored according to their teachers’ responses characterizing twelve aspects on the School Emphasis on Academic 
Success scale. Students in schools where their teachers reported a Very High Emphasis on academic success had a score on the 
scale of at least 12.8, which corresponds to their teachers characterizing six of the twelve aspects as “very high” and the other six 
as “high,” on average. Students in schools with a Medium Emphasis on academic success had a score no higher than 9.2, which 
corresponds to their teachers characterizing six of the twelve aspects as “medium” and the other six as “high,” on average. All 
other students attended schools with a High Emphasis on academic success. 


Very High Emphasis High Emphasis Medium Emphasis 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Average 
Country Percent hyefage Percent Average Percent Average Scale Score 
Oman 441 ic (3.2) 41 ual tal 407 id 11.4 (0.14) 
United Arab Emirates 24 oa 485 (7.8 59 (2.6) 452 (4.6 7 (1.7 409 (6.2 11.3 (0.10) 
Qatar 23 (2.2) 459 (7. 5 63 (2.4 438 (3. 5 : (1. , 435 oi 11.5 (0.12) 
Bahrain 22 (2.0 482 (5.8 53 (2.8 445 (3.4 25 (2.5 417 (7.1 10.9 (0.16) 
Kazakhstan 21 (2.8 535 (7.1 74 (3.1 536 (3.2 5 (1.4 547 (14.3) 11.6 (0.12) 
England 19 (2.6 568 (4.4 62 (3.7 559 (2.6 18 (3.1 548 (4.7 11.0 (0.14) 
Northern Ireland 19 (3.1 579 (5.6 68 (3.9 561 (3.0 14 (3.0 556 (8.2 11.4 (0.15) 
Ireland 16 (2.7 579 (6.7 67 (3.5 571 (2.9 17 (2.6 539 (6.1 11.0 (0.16) 
South Africa r 15 (2.6 324 (10.3) 42 (3.7 326 (8.9 43 (3.8 313 (8.5 10.1 (0.20) 
Saudi Arabia 15 (2.5 451 (10.8) 53 (3.9 442 (5.8 32 (3.7 403 (8.9 10.3 (0.17) 
Australia 15 (2.1 584 (6.7 59 (3.1 546 (3.0 27 (2.7 523 (4.4 10.6 (0.14) 
Israel 14 (3.2 540 (12.9) 66 (3.6 533 (3.9 20 (3.0 515 (10.3) 10.7 (0.17) 
New Zealand 13 (2.3) 545 (6.9) 65 (2.8) 532 (3.0) 23 (2.5) 501 (5.7) 10.7 (0.13 
Kuwait 12 (3.4 407 (21.0) 61 (4.4 400 (6.0 27 (3.7 377 (10.2) 10.5 (0.22 
Spain 10 (1.8 544 (4.1) 62 (3.6 531 (2.3 28 (3.3) 516 (3.5) 10.5 (0.10 
Iran, Islamic Rep. of 9 (2.7 440 (14.6) 56 (4.1 436 (6.4) 34 (3.8 412 (8.8) 10.1 (0.18 
Egypt 9 (2.6) 397 (18.0) 44 (4.4) 341 (8.2) 47 (4.5) 308 (8.4) 9.7 (0.19 
United States Y Op 562 (7.1) 58 (3.5 563 (3.3 33 (3.3) 524 (5.4) 10.0 (0.16 
Azerbaijan 9 (1.8) 476 (12.0) 67 (3.3) 478 (5.2) 24 (3.2) 456 (8.3) 10.4 (0.12 
Austria 9 (2.1) 563 (4.9) 63 (3.5) 546 (2.4) 28 (3.1) 523 (4.8) 10.3 (0.13 
Malta 8 (0.1) 451 (4.9) 63 (0.1) 461 (1.9) 29 (0.1) 433 (2.9) 10.4 (0.00) 
Canada 8 (1.3) 556 (6.6) 56 (2.4) 549 (2.2) 36 (2.4) 532 (3.5) 10.2 (0.10) 
Sweden 7 (2.3) 567 (8.8) 55 (4.2) 560 (3.1) 38 (3.9) 547 (3.4) 10.0 (0.14) 
Georgia 7 (2.0) 511 (12.0) 70 (3.3) 490 (3.1) 23 (3.1) 480 (7.4) 10.4 (0.14) 
Poland 6 (2.1) 568 (11.4) (3.9) 568 (3.1) (4.1) 559 (3.9) 9.8 (0.16) 
Portugal 5 (1.5) 547 (5.4) 53 (3.7) 534 (3.4) AI (3.4) 518 (3.0) 9.7 (0.11) 
Trinidad and Tobago 5 (2.0) 499 (27.2) 36 (3.6) 502 (6.9) 59 (3.6) 465 (5.1) 8.9 (0.18) 
Singapore 5 (1.3) 610 (16.3) 49 (2.7 588 (4.4) 46 (2.7 560 (4.4 9.6 (0.09) 
Lithuania 5 (1.4) 574 (8.3) 78 (3.2 552 (2.7 17 (2.8 524 (8.3 10.5 (0.09) 
Latvia 4 (1.8 564 (7.4) 66 (3.7 562 (2.4 30 (3.7 549 (3.6 10.0 (0.12) 
Bulgaria 4 (13 577 (11.3) 61 (3.6 569 (4.3 35 (3.5 519 (8.9 9.9 (0.12) 
France 4 (1.6 537 (10.3) 51 (3.4 518 (2.9 44 (3.2 502 (4.0 9.6 (0.11) 
Denmark 4 (1.9 564 (11.4) 54 (3.6 553 (3.1 42 (3.5 540 (3.0 9.7 (0.12) 
Italy 3 (14 556 (12.6) 55 (3.7 551 (3.3 42 (3.4 546 (3.1 9.6 (0.12) 
Hong Kong SAR 3 (0.9 578 (11.4) 50 (3.6 572 (4.1 47 (3.5 564 (4.3 9.3 (0.10) 
Hungary 3 (1.1 587 (20.4) 49 (4.1 570 (3.5 49 (4.2 536 (5.2 9.3 (0.13) 
Chinese Taipei 3 (0.8) 556 (7.3) 57 (3.9) 562 (2.6) 40 (4.0) 556 (3.1) 9.7 (0.11) 
Slovak Republic 3 (0.9 567 (12.2) 48 (2.6 550 (3.2 49 (2.6 518 (5.6 9.4 (0.10) 
Morocco 3 (1.0) 422 (19.0) 23 (2.2 412 (6.9 74 (2.2 338 (4.6 8.2 (0.11) 
Finland 2 (0.8 oo 66 (2.8 570 (2.0 32 (2.9 558 (3.7 9.9 (0.10) 
Chile 2 (1.0) ial 11 (2.3) 491 (6.6) 87 (2.5) 496 (3.2) 7.6 (0.14) 
Germany 2 (1.0) a oe 54 (3.5) 555 (2.7) 44 (3.3) 512 (6.6) 9.4 (0.09) 
Netherlands 2 (1.2) oo 50 (3.5) 550 (2.4) 48 (3.6) 539 (2.6) 9.5 (0.10) 
Czech Republic 2 (0.8) oe 38 (3.2) 551 (2.9) 60 (3.2) 538 (2.8) 9.1 (0.11) 
Macao SAR 1 (0.0) a 49 (0.1) 554 (1.5) 50 (0.1) 537 (1.4) 9.5 (0.00) 
Belgium (Flemish) 1 (0.6) moe 53 (3.9) 532 (2.3) 46 (3.9) 517 (3.1) 9.4 (0.10) 
Russian Federation 1 (0.7) ied 53 (3.2) 592 (2.7) 46 (3.3) 567 (3.7) 9.5 (0.10) 
Belgium (French) 1 (0.6) om e (3.8) 511 (2.9) i (3.7) 485 (3.8) 9.2 (0.12) 
Norway (5) 1 (0.6) cas 58 (3.6) 563 (2.7) Al (3.7) 551 (3.4) 9.6 (0.11) 
Slovenia 1 (0. 43 (3.4) 546 (3.2) 56 (3.5) 540 (2.2) 9.1 (0.10) 


4) 
International Avg. EGE) 55 (0.5) ES) AC) 497 (0.9) 


This PIRLS questionnaire scale was established in 2016 based on the combined response distribution of all countries that participated in PIRLS 2016. To provide a point of 
reference for country comparisons, the scale centerpoint of 10 was located at the mean of the combined distribution. The units of the scale were chosen so that 2 scale 
score points corresponded to the standard deviation of the distribution. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A tilde (~) indicates insufficient data to report achievement. 
An “r" indicates data are available for at least 70% but less than 85% of the students. 


TIMSS & PIRLS 
IEA International Study Center 


Z 
Zw Lynch School of Education 
Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


203 


Exhibit 6.3: School Emphasis on Academic Success — Teachers’ Reports 
(Continued) 


Very High Emphasis High Emphasis 


Country Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement 


Benchmarking Participants 


Dubai, UAE 32 (2.9) 538 (6.0) 55 (3.0) 517 (3.9) 
Abu Dhabi, UAE 18 (3.2) 447 (10.0) 57 (4.2) 418 (7.8) 
Madrid, Spain 13 (2.8) 564 (7.5) 68 (4.0) 551 (1.9) 
Andalusia, Spain 12 (2.4) 538 (4.0) 59 (4.4) 531 (2.1) 
Eng/Afr/Zulu - RSA (5) r 10 (3.7) 435 (24.7) 46 (5.7) 407 (11.1) 
Ontario, Canada 9 (2.5) 551 (12.2) 50 (4.1) 554 (3.8) 
Buenos Aires, Argentina 7 (2.2) 500 (9.1) 53 (4.0) 492 (4.3) 
Norway (4) 5 (1.7) 538 (10.5) 54 (4.0) 521 (2.8) 
Quebec, Canada 4 (2.0) 561 (12.0) 63 (5.2) 551 (4.1) 
Denmark (3) 4 (0.9) 529 (14.0) 54 (3.8) 507 (3.5) 
Moscow City, Russian Fed. 1 (0.8) ~~ 64 (4.0) 619 (2.6) 


How would you characterize each of the following within your school? 


Medium Emphasis 


13 (1.5) 
25 (3.3) 
19 (3.2) 
30 (3.9) 
44 (6.0) 
40 (4.1) 
40 (3.6) 
40 (3.8) 
33 (5.0) 
42 (3.9) 
35 (3.9) 


Very high High Medium Low 


Teachers’ understanding of the school’s | | 


curricular g0als —---------------------------------=-==== O—— (C) oo () so () 


Teachers’ degree of success in implementing 


464 (7.5) 
388 (10.4) 
531 (4.0) 
507 (5.0) 
418 (11.6) 
531 (5.4) 
459 (5.3) 
510 (2.8) 
536 (5.0) 
490 (4.4) 
601 (3.2) 


Very low 


Vv 
ee) 


the school’s curriculum CO = C) es (~) es (>) (~) 


Teachers’ expectations for student 


achievement CO —— () es (~) es (>) (~) 


Teachers’ ability to inspire students Q — (—) es (7) as (ss () 


Collaboration between school leadership 
(including master teachers) and 


teachers to plan instruction QO eC) es (T) es () es (>) 
Parental involvement in school activities —-—-- Q ==) ==) =O =O) 


Parental commitment to ensure that 


students are ready to learn OC — (—) os (~) ss (sos () 


Parental expectations for 


student achievement O—— (7) a (7) es (~) ss (~) 
Parental support for student achievement O — O ——e (_) —<——= — O 
10) Students’ desire to do well in school ------------- O—— (—) es (~) es (ss (~) 


11) Students’ ability to reach 


school’s academic goals CO —— (C) es (~) ae () (~) 


12) Students’ respect for classmates 
who excel academically: OQ — C) es (7) as () ses () 


SS 


Very High High Medium Emphasis 
Emphasis Emphasis 


12.8 9.2 


Downloaded from http://pirls2016.org/download-center/ 


ZF 
iF 


Average 


Scale Score 


12.0 (0.14) 
10.7 (0.19) 
10.9 (0.15) 
10.3 (0.14) 
9.9 (0.32) 
10.1 (0.17) 
9.8 (0.15) 
9.7 (0.12) 
10.2 (0.17) 
9.6 (0.13) 
9.7 (0.09) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 6.4: Emphasis in Early Grades on Reading Skills and Strategies 
Exhibit 6.4 provides information about the reading curricula in fourth grade schools. Principals were 
given a list of the reading skills and strategies assessed by PIRLS 2016 and asked to indicate at what 
grade these skills were first emphasized for at least 50 percent of the students. The grade shown in 
Exhibit 6.4 for the reading skill or strategy is the median grade reported by the principals in each 
country. For example, at least half the students in every country are in schools emphasizing the first 
three skills by first grade—knowing letters of the alphabet, letter-sound relationships, and reading 
words. In many countries, at least half the students are in schools emphasizing locating information 
and finding main ideas by the second grade. By the third grade, at least half the students in a number 


of countries are in schools emphasizing comparisons of texts with personal experience or other texts, 
and by the fourth grade are emphasizing looking at text structure and author’s perspective. 


CHAPTER 6: SCHOOL CLIMATE “ TIMSS & PIRLS ads 
International Study Center 5 
PIRLS 2016 INTERNATIONAL RESULTS IN READING Gg IE eee eae 
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Czech Republic 
Denmark 
Egypt 


England 
Finland 
France 


Georgia 


Germany 


Hong Kong SAR 
Hungary 


Iran, Islamic Rep. of 


Ireland 
Israel 
Italy 


Kazakhstan 


Kuwait 
Latvia 


Lithuania 


Macao SAR 


Malta 


Morocco 


Netherlands 


New Zealand 


Northern Ireland 
Norway (5) 


Oman 


Poland 


Portugal 
Qatar 


Russian Federation 


Saudi Arabia 
Singapore 


Slovak Republic 


Slovenia 


South Africa 


Spain 


Sweden 


Trinidad and Tobago 


United Arab Emirates 


United States 


N 


2 


2) 


2 


1 


2 


1 


2 


1 


1 


1 


1 


1 


1 


1 


Not by Grade 4 


“rc” indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are available for at least 50% but less than 70% of the students. 
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Exhibit 6.5: Teacher Job Satisfaction 


Teachers who are satisfied with their profession and the working conditions at their school are 
more motivated to teach and prepare their instruction. Satisfied teachers also may be more likely 
to remain in the classroom. Exhibit 6.5 presents the results of the Teacher Job Satisfaction scale (see 
the exhibit for details about the scale). Across the PIRLS 2016 countries, almost all students were 
taught reading by teachers who were Very Satisfied (57%) or Somewhat Satisfied (37%) with their 
profession, with only 6 percent taught by Less than Satisfied teachers. Average reading achievement 
was similar between students whose teachers were Very Satisfied or Somewhat Satisfied (513 vs. 
508). For the 6 percent with the least satisfied teachers, achievement appears somewhat higher 
although the percentages are very small in most countries. 
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Exhibit 6.5: Teacher Job Satisfaction 


Students Categorized by Teachers’ Reports 


WAU ip crade 


Students were scored according to how often their teachers responded positively to the five statements on the Teacher Job 
Satisfaction scale. Students with Very Satisfied teachers had a score on the scale of at least 10.2, which corresponds to their 
teachers responding “very often” to three of the five statements and responding “often” to the other two, on average. Students 


with Less than Satisfied teachers had a score no higher than 6.2, which corresponds to their teachers responding “sometimes” to 


three of the five statements and “often” to the other two, on average. All other students had Somewhat Satisfied teachers. 


Country 


Iran, Islamic Rep. of 
Saudi Arabia 
Oman 

Chile 

Kuwait 

Qatar 

Egypt 

United Arab Emirates 
Azerbaijan 
Bahrain 

Spain 

Morocco 

Israel 

Georgia 
Kazakhstan 

South Africa 
Malta 

Northern Ireland 
Ireland 

Austria 

Australia 

Italy 

United States 
New Zealand 
Canada 

Belgium (Flemish) 
Trinidad and Tobago 
England 

Belgium (French) 
Portugal 

Hungary 

Chinese Taipei 
Russian Federation 
Macao SAR 
Slovak Republic 
Netherlands 
Latvia 

Poland 

Denmark 

Norway (5) 
Lithuania 

Sweden 

Finland 

Bulgaria 
Singapore 
Slovenia 
Germany 

Hong Kong SAR 
Czech Republic 
France 


r 


Very Satisfied 


88 (2.3) 
87 (2.3) 
86 (2.0) 
84 (3.3) 
82 (4.6) 
82 (1.9) 
81 (3.0) 
79 (2.0) 
79 (3.0) 
75 (3.2) 
73 (3.0) 
23 (3.1) 
72 (3.7) 
72 (3.1) 
68 (3.1) 
65 (3.3) 
64 (0.1) 
62 (4.7) 
60 (3.6) 
59 (3.9) 
58 (3.6) 
58 (3.4) 
57 (4.1) 
57 (2.6) 
56 (2.4) 
53 (3.5) 
52 (3.9) 
51 (3.7) 
51 (3.3) 
49 (3.7) 
48 (3.9 
47 (3.8 
47 (3.4 
45 (0.1 
Bah 
4.0) 
3.6 
4.1 
43 (3.6 
42 (4.1 
42 (3.7 
41 (43 
41 (3.5 
40 (3.8 
40 (2.4) 
38 (3.4) 
38 (3.6) 
34 (4.2) 
33 (3.8) 
26 (2.8) 


45 
44 
44 
B 


428 (4.1) 
436 (4.8) 
419 (3.5) 
497 (3.4) 
390 (5.4) 
440 (2.3) 
329 (6.7) 
450 (3.8) 
475 (4.8) 
448 (2.9) 
529 (2.4) 
367 (4.9) 
527 (3.9) 
492 (3.4) 
538 (3.1) 
325 (6.1) 
458 (2.2) 
564 (3.4) 
570 (3.8 
542 (2.8 
546 (3.6 
549 (3.1 
554 (3.8 
531 (3.0 
542 (2.4 
526 (2.9 
485 (5.7 
558 (3.4 
503 (3.5 
531 (2.8 
556 (4.7 
558 (3.0) 
582 (3.5 
553 (1.5 
534 (4.6 
542 (3.3 
564 (2.2 
563 (3.8 
548 (3.5) 
560 (3.3) 
555 (3.7) 
554 (4.0) 
565 (2.6) 
557 (6.2) 
576 (6.2) 
544 (2.4) 
544 (4.8) 
568 (5.9) 
545 (3.1) 
513 (4.4) 


Somewhat Satisfied 


Percent 


Percent Average 
of Students Achievement 


of Students 
10 (2.2) 
11 (2.4) 
14 (2.0) 
16 (3.3) 
16 (4.5) 
17 (2.0) 
18 (3.1) 
19 (2.0) 
21 (3.0) 
24 (3.1) 
25 (3.1) 
24 (3.3) 
25 (3.6) 
28 (3.1 
31 (3.2 
28 (3.7 
31 (0.1 
31 (4.2 
36 (3.5 
40 (3.8 
39 (3.6 
38 (3.4 
37 (3.9 
40 (2.6 
40 (2.3 
44 (3.3 
37 (4.0 
42 (3.8 
40 (3.4 
41 (3.8 
49 (3.6 
40 (3.7 
52 (3.4 
46 (0.1) 
45 (3.7) 
53 (4.0) 
54 (3.7) 
44 (3.7) 
45 (3.9) 
53 (3.9) 
51 (4.1) 
52 (4.6) 
49 (3.2) 
52 (3.6) 

46 (2.7) 
53 (3.4) 
53 (4.0) 
47 (4.2) 
53 ( 
62 ( 


3.8) 
3.3) 


Average 
Achievement 
427 (14.7) 
391 (10.2) 
415 (10.4) 
497 (10.2) 
408 (13.7) 
453 (10.9) 
335 (15.2) 
464 (7.3) 
464 (9.2) 
442 (6.7 
524 (3.4) 
333 (7.9 
543 (8.7 
484 (5.4) 
532 (4.8 
297 (7.9) 
441 (2.9) 
567 (4.0, 
561 (3.9) 
540 (3.7 
545 (4.3) 
547 (3.8) 
547 (5.8) 
521 (4.4) 
545 (2.6) 
524 (2.8) 
472 (6.1) 
559 (2.8) 
494 (4.3) 
526 (4.9) 
553 (4.5) 
558 (3.0) 
579 (3.7) 
537 (1.6) 
536 (4.6) 
549 (2.2) 
554 (2.7) 
566 (2.9) 
546 (3.3) 
560 (2.6) 
546 (4.1) 
557 (3.3 
567 (2.6 
548 (6.5 
573 (4.5 
539 (2.9 
533 (5.4) 
572 (3.5 
543 i 
Se 


Less than Satisfied 


Percent Average 
of Students Achievement 


2 (0.9) 
2 (1.1) 
0 (0.4) 
0 (0.0) 
2 (1.1) 
1 (0.6) 
0 (0.4 
2 (0.6 
0 (0.4 
1 (0.8 
2 (0.9 
3 (0.9 
3 (13, 
0 (0.3 
1 (1.0 
7 (2.1) 
5 (0 
7 


(2.5 


4(1 
1 (0.6 
2 (0.8) 
3 (1.6) 
6 (1.8) 
4 (1.0) 
4 (1.0) 
3 (1.2) 

11 (2.7) 
7 (2.0) 
9 (2.3) 

10 (2.1) 
3 (1.6) 

i 25(23) 
2 (0.9) 

9 (0.1) 

11 (2.5) 

3 (1.1 

2 (1.1 


.1) 
) 
3) 
) 


4 (1.2 
7 (21 
6 (2.1 
11 (1.8 
8 (2.2 
14 (1.9 
9 (2.0 
10 (2.3 
19 (2.9 
13 (23 
“ a 


339 (15.7) 
496 (46.4) 


376 (20.4) 
453 (6.5) 
548 (9.0) 
561 (8.9) 


559 (11.2) 
522 (9.2) 
527 (15.8) 
542 (8.4) 
532 (13.9) 
481 (15.2) 
563 (7.1) 
484 (10.2 
523 (4.2) 
537 (13.0 
563 (4.9 
551 (3.3 
531 (11.3 
528 (11.9 


564 (6.0 
551 (5.1 
544 (19.4) 
527 (17.4 
549 (9.4 
568 (4.4 
543 (12.4) 
587 (6.6) 
550 (8.6) 
524 (10.0) 
561 (6.4) 
540 (8.4) 
506 (6.6) 


International Avg. 57 (0.5) 513 (0.6) EVA(0S)) 508 ( = 525 (2.3) 


This PIRLS questionnaire scale was established in 2016 based on the combined response distribution of all countries that participated in PIRLS 2016. To provide a point 
of reference for country comparisons, the scale centerpoint of 10 was located at the mean of the combined distribution. The units of the scale were chosen so that 2 


scale score points corresponded to the standard deviation of the distribution. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


A tilde (~) indicates insufficient data to report achievement. International average achievement for the "Less than Satisfied" category does not include achievement for many lower 


performing countries. 


An 


an 
r 
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indicates data are available for at least 70% but less than 85% of the students. 


ZF 
iF, 


Average 


Scale Score 


11.2 (0.08) 
11.3 (0.08) 
11.3 (0.07) 
11.3 (0.11) 
11.1 (0.13) 
11.1 (0.07) 
11.1 (0.09) 
11.0 (0.07) 
10.9 (0.09) 
10.9 (0.12) 
10.7 (0.08) 
10.7 (0.10) 
10.7 (0.14) 
10.8 (0.09) 
10.7 (0.10) 
10.2 (0.13) 
10.3 (0.00) 
10.2 (0.20) 
10.1 (0.16) 
10.3 (0.13) 
10.3 (0.13) 
10.2 (0.13) 
10.1 (0.15) 
10.1 (0.11) 
10.2 (0.09) 
10.0 (0.13) 
9.7 (0.17) 
9.8 (0.14) 
9.6 (0.16) 
9.4 (0.14) 
9.6 (0.16 
9.4 (0.17 
9.7 (0.12 
9.4 (0.00 
9.4 (0.15 
9.7 (0.13 
9.7 (0.13 
9.4 (0.20) 
9.3 (0.15 
9.6 (0.15 
9.7 (0.13 
9.5 (0.16) 
9.4 (0.15 
9.3 (0.16) 
9.3 (0.12) 
9.4 (0.15) 
9.2 (0.14) 

) 

) 

) 


8.8 (0.20 
8.9 (0.17, 
8.7 (0.12 
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Exhibit 6.5: Teacher Job Satisfaction (Continued) 


Very Satisfied 


Country Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement 


Benchmarking Participants 


Buenos Aires, Argentina 82 (3.0) 
Madrid, Spain 81 (3.1) 
Andalusia, Spain 75 (3.9) 
Dubai, UAE 75 (2.2) 
Abu Dhabi, UAE 75 (3.8) 
Norway (4) 56 (3.8) 
Eng/Afr/Zulu - RSA (5) r 56 (5.7) 
Moscow City, Russian Fed. 55 (3.8) 
Ontario, Canada 54 (4.3) 
Quebec, Canada 52 (4.9) 
Denmark (3) 43 (3.9) 


480 (3.4) 
551 (2.3) 
525 (2.7) 
516 (2.7) 
411 (6.0) 
518 (2.8) 
401 (8.7) 
611 (2.9) 
546 (3.8) 
544 (4.3) 
500 (4.3) 


Somewhat Satisfied 


17 (2.9) 
17 (3.0) 
23 (3.8) 
22 (2.2) 
22 (3.7) 
Al (3.8) 
41 (5.8) 
43 (3.9) 
42 (4.5) 
45 (5.1) 
51 (4.0) 


How often do you feel the following way about being a teacher? 


1) lam content with my profession as a teacher --- 


2) | find my work full of meaning and purpose -- 


3) lam enthusiastic about my job 
4) My work inspires me 


5) lam proud of the work I do 


Downloaded from http://pirls2016.org/download-center/ 


Satisfied 
10.2 


Somewhat 
Satisfied 


478 (9.8) 
542 (4.4) 
525 (3.6) 
519 (6.4) 
430 (13.8) 
517 (3.1) 
433 (10.7) 
613 (3.3) 
542 (4.9) 
551 (3.4) 
504 (3.9) 


Less than Satisfied 


1 (0.7) 
2 (1.1) 
2 (1.2) 
2 (0.4) 
3 (1.5) 
3 (1.1) 
4 (2.0) 
2 (1.2) 
5 (2.0) 
3 (1.2) 
6 (1.9) 


Never or 
almost 


Sometimes never 


6.2 


ELS eee 


i Less than Satisfied 


438 (27.4) 
492 (12.8) 
436 (46.5) 
545 (12.1) 
540 (7.4) 
490 (9.6) 


ZF 
iF 


Average 


Scale Score 


11.1 (0.09) 
11.0 (0.12) 
10.9 (0.13) 
10.9 (0.07) 
10.8 (0.15) 
10.1 (0.14) 
10.1 (0.21) 
10.1 (0.13) 
10.1 (0.15) 
10.1 (0.16) 
9.5 (0.16) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 6.6: Students’ Sense of School Belonging 
To develop the Sense of School Belonging scale, students were asked how much they agreed with five 
statements about their attitude toward school. Exhibit 6.6 presents students’ very positive responses. 
On average, more than half (59%) had a High sense of belonging, 33 percent had Some sense of 
belonging, and only 8 percent of the fourth grade students had Little sense of belonging. A higher 
sense of school belonging was related to higher average reading achievement (518, 505, and 495, 


respectively). 
CHAPTER 6: SCHOOL CLIMATE BZ TIMSS & PIRLS 
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Exhibit 6.6: Students’ Sense of School Belonging 


Students' Reports 

Students were scored according to their agreement with five statements about their Sense of School Belonging. Students with a 
High Sense of School Belonging had a score on the scale of at least 9.7, which corresponds to their “agreeing a lot” to three of 
the five statements and “agreeing a little” to each of the other two statements, on average. Students with Little Sense of School 
Belonging had a score no higher than 7.3, which corresponds to their “disagreeing a little” to three of the five statements and 


“agreeing a little” to each of the other two statements, on average. All other students had Some Sense of School Belonging. 


Country 


High Sense of 


School Belonging 


Percent 
of Students 


Average 
Achievement 


Percent 
of Students 


Average 
Achievement 


Little Sense of 


Some Sense of 
ool Belonging 


School Belonging 


Percent 
of Students 


Average 
Achievement 


Average 


Scale Score 


Egypt 87 (1.2) 331 (5.8) 12 (1.1) 335 (9.7) 2 (0.2) 11.6 (0.08) 
Kazakhstan 84 (0.8) 537 (2.5) 15 (0.7) 533 (3.5) 1 (0.2) ~~ 11.4 (0.04) 
Morocco 82 (1.1) 362 (4.4) 16 (1.0) 345 (5.7) 2 (0.2) ~~ 11.4 (0.06) 
Azerbaijan 82 (0.9) 480 (3.7) 16 (0.7) 458 (5.7) 2 (0.3) ~~ 11.2 (0.05) 
Portugal 82 (0.9) 532 (2.4) 15 (0.8) 511 (4.2) 3 (0.3) 510 (9.2) 11.2 (0.05) 
Georgia 75 (1.0) 493 (3.0) 21 (0.8) 483 (3.7) 3 (0.4) 469 (9.3) 10.8 (0.06) 
Bulgaria 74 (1.3) 551 (4.5) 22 (1.1) 557 (5.3) 4 (0.5) 547 (13.2) 10.8 (0.06) 
Saudi Arabia 70 (1.6) 444 (4,3) 25:(1.3) 415 (5.4) 6 (0.6) 386 (10.1) 10.7 (0.08) 
Oman 69 (1.1) 433 (3.4) 25 (0.9) 396 (3.6) 6 (0.4) 383 (6.9) 10.6 (0.06) 
Spain 69 (0.8) 532 (1.4) 26 (0.7) 521 (3.6) 5 (0.3) 511 (4.5) 10.4 (0.03) 
Norway (5) 69 (1.3) 565 (2.4) 27 (1.1) 550 (3.0) 4 (0.5) 530 (7.1) 10.4 (0.06) 
Kuwait 66 (1.3) 404 (3.8) 28 (1.2) 385 (6.3) 7 (0.5) 366 (9.6) 10.4 (0.06) 
Malta 64 (0.8) 465 (2.0) 29 (0.8) 436 (3.5) 7 (0.4) 411 (6.8) 10.3 (0.03) 
Northern Ireland 63 (1.5) 575 (2.4) 30 (1.2) 554 (3.3) 7 (0.6) 520 (7.6) 10.2 (0.06) 
Finland 63 (1.3) 574 (2.0) 32 (1.1) 558 (2.5) 5 (0.5) 526 (7.3) 10.2 (0.05) 
New Zealand 62 (0.9) 532 (2.6) 31 (0.7) 514 (3.3) 6 (0.5) 497 (5.8) 10.2 (0.04) 
Netherlands 62 (1.3) 552 (1.9) 32° (1,1) 539 (2.1) 7 (0.7) 512 (6.8) 10.1 (0.06) 
Lithuania 61 (1.3) 554 (2.7) 34 (1.2) 542 (3.5) 5 (0.4) 532 (7.4) 10.1 (0.05) 
lreland 61 (1.4) 577 (2.5) 31 (1.0) 557 (3.4) 8 (0.8) 533 (5.7) 10.1 (0.06) 
Chile G1 (1.2) 507 (2.7) 28 (0.9) 485 (4.1) 11 (0.6) 465 (5.4) 10.1 (0.06) 
Iran, Islamic Rep. of 61 (1.6) 421 (4.8) 34 (1.4) 445 (4.4) 5 (0.4) 415 (10.7) 10.4 (0.08) 
South Africa 59 (1.1) 331 (3.6) 31 (0.9) 314 (6.2) 9 (0.6) 300 (8.6) 10.2 (0.06) 
Denmark 59 (1.4) 558 (2.4) 34 (1.1) 537 (3.0) 7 (0.6) 519 (5.2) 10.0 (0.06) 
Sweden 58 (1.5) 563 (2.8) 352) 549 (3.0) 7 (0.7) 533 (5.7) 10.0 (0.06) 
Bahrain 58 (1.4) 461 (3.0) 33 (1.0) 435 (2.8) 10 (0.6) 415 (6.3) 10.0 (0.07) 
Australia 57 (1.0) 554 (3.1) 33 (0.9) 537 (3.2) 10 (0.5) 517 (4.6) 9.9 (0.04) 
Hungary 57 (1.5) 560 (3.4) 35 (1.2) 548 (3.5) 8 (0.8) 537 (5.7) 9.9 (0.06) 
Canada 57 (0.9) S51020) 35 (0.8) 540 (2.5) 8 (0.4) 515 (3.8) 9.9 (0.04) 
England 56 (1.4) 569 (2.1) 35 (1.0) 552 (2.3) 9 (0.7) 526 (4.5) 9.9 (0.06) 
United Arab Emirates 56 (0.8) 473 (3.4) 34 (0.7) 433 (3.9) 10 (0.4) 406 (6.0) 10.0 (0.04) 
Belgium (Flemish) 56 (1.2) 533 (2.2) 36 (1.0) 520 (2.6) 7 (0.5) 496 (4.6) 9.9 (0.05) 
Italy 56 (1.2) 554 (2.3) 36 (1.0) 543 (2.7) 8 (0.5) 532 (4.3) 9.8 (0.05) 
Russian Federation 54 (1.3) 582 (2.7) 40 (1.2) 582 (2.5) 6 (0.4) 572 (4.3) 9.8 (0.05) 
Trinidad and Tobago 54 (1.8) 490 (3.9) 35 (1.4) 471 (4.3) 10 (0.8) 456 (6.6) 9.8 (0.08) 
United States 54 (1.3) 562 (3.1) 34 (1.0) 544 (3.6) 13 (0.8) 526 (5.3) 9.8 (0.06) 
Austria 52 (1.1) 547 (2.5) 38 (0.9) 537 (2.8) 10 (0.6) 524 (4.4) 9,7 (0.05) 
Israel 51 (1.4) 529 (2.8) 35 (1.2) 534 (3.9) 15 (1.0) 536 (5.8) 9.6 (0.07) 
Qatar 50 (0.8) 465 (2.0) 35 (0.7) 437 (3.0) 15 (0.6) 404 (3.5) 9.6 (0.04) 
Slovak Republic 50 (1.1) 534 (4.6) 4] (1.0) 539 (3.1) 9 (0.6) 525 (4.8) 9.6 (0.05) 
Latvia 49 (1.4) 560 (2.2) 43 (1.1) 559 (2.2) 8 (0.7) 538 (5.3) 9.6 (0.06) 
Singapore 49 (0.9) 583 (3.5) 42 (0.8) 574 (3.3) 9 (0.4) 550 (4.9) 9.6 (0.04) 
Germany 47 (1.7) 556 (2.7) 4] (1.2) 536 (3.9) 12 (0.7) 516 (6.3) 9.4 (0.07) 
Slovenia 44 (1.4) 544 (2.7) 46 (1.2) 542 (2.4) 10 (0.9) 537 (4.1) 9.3 (0.05) 
Belgium (French) 43 (1.3) 503 (3.0) 42 (1.1) 497 (3.0) 15 (1.0) 482 (4.1) 9.3 (0.06) 
France 43 (1.6) 512 (2.7) 48 (1.2) 514 (2.6) 9 (0.8) 492 (5.1) 9.4 (0.05) 
Czech Republic 42 (1.1) 547 (3.2) 48 (1.0) 545 (2.3) 9 (0.5) 525 (4.1) 9.3 (0.04) 
Poland 42 (1.4) 562 (2.6) 46 (1.1) 569 (2.8) 12 (0.8) 560 (4.4) 9.3 (0.06) 
Chinese Taipei 4] (1.3) 569 (2.3) 46 (1.1) 557 (2.5) 13 (0.6) 537 G7) 9.2 (0.05) 
Macao SAR ul (0.7) 557 (1.8) 50 (0.7) 541 (1.7) 13 (0.6) 532 (3.2) 9.1 (0.03) 
Hong Kong SAR = 2) 580 ~ a 48 - 0) 567 ~ 9) a - - 553 ~ - 8.9 (0.06) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


This PIRLS questionnaire scale was established in 2016 based on the combined response distribution of all countries that participated in PIRLS 2016. To provide a point 


of reference for country comparisons, the scale centerpoint of 10 was located at the mean of the combined distribution. The units of the scale were chosen so that 2 


scale score points corresponded to the standard deviation of the distribution. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A tilde (~) indicates insufficient data to report achievement. 
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Exhibit 6.6: Students’ Sense of School Belonging (Continued) 


High Sense of Some Sense of Little Sense of 
Chat School Belonging School Belonging School Belonging 
ountry 
Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement 


Benchmarking Participants 


Andalusia, Spain 71 (1.2) 528 (2.1) 23 (0.9) 519 (3.0) 6 (0.5) 509 (6.3) 
Norway (4) 70 (1.2) 522 (2.4) 25 (0.9) 508 (3.7) 5 (0.5) 493 (5.9) 
Madrid, Spain 69 (1.5) 551 (2.0) 26 (1.3) 547 (3.2) 5 (0.5) 531 (5.2) 
Dubai, UAE 61 (0.8) 532 (1.9) 32 (0.7) 502 (2.8) 8 (0.3) 455 (6.0) 
Eng/Afr/Zulu - RSA (5) 60 (1.7) 405 (5.1) 31 (1.2) 418 (9.1) 9 (1.0) 400 (12.5) 
Denmark (3) 58 (1.3) 510 (2.9) 35 (1.1) 491 (3.9) 7 (0.5) 475 (7.1) 
Ontario, Canada 53 (1.5) 554 (3.7) 38 (1.3) 539 (4.2) 9 (0.6) 514 (6.5) 
Buenos Aires, Argentina 52 (1.1) 484 (3.4) 37 (0.8) 484 (3.7) 11 (0.7) 478 (5.8) 
Quebec, Canada 51 (1.8) 553 (3.3) 40 (1.6) 545 (2.9) 8 (0.7) 527 (5.2) 
Moscow City, Russian Fed. 50 (1.2) 616 (2.4) 42 (1.0) 611 (2.4) 8 (0.6) 597 (5.1) 
Abu Dhabi, UAE 49 (1.6) 437 (5.3) 38 (1.2) 401 (5.9) 12 (0.9) 391 (9.0) 


What do you think about your school? Tell how much you agree with these statements. 
Agree a lot Agree a little Disagree Disagree 


alittle alot 


1 


) Hike being in school 
2) | feel safe when | am at school 
) 


3) | feel like | belong at this school 


4) Teachers at my school are fair to me 


5) lam proud to go to this school 


High Sense Some Sense Little Sense 
of School of School of School 
Belonging 97 Belonging 73 Belonging 


i) 

Zw 

= 
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Average 


Scale Score 


10.5 (0.06) 
10.5 (0.05) 
10.4 (0.07) 
10.1 (0.04) 
10.2 (0.08) 
10.0 (0.06) 
9.8 (0.06) 
9.7 (0.05) 
9.7 (0.06) 
9.6 (0.05) 
9.7 (0.07) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Students Are in Safe Schools 


Internationally, the majority of fourth grade students were in safe school environments 
according to their principals and teachers. However, students who attended schools 
with disorderly environments had much lower achievement than their counterparts 

in safe and orderly schools. 


Principals’ Reports 


of students were in 
OK schools where principals 
Oo reported HARDLY ANY 


discipline problems 


of students were in 
schools where principals 
reported only MINOR 
discipline problems 


% 
8% 
Average Average 


Achievement Achievement 


518 503 


30% 


of students were 

in schools where 
principals reported 
MODERATE TO SEVERE 
discipline problems 


Teachers’ Reports 


re) of students were in schools 
6 2 Yo that teachers found Teachers in 16 countries 
VERY safe and orderly reported schools were 
more safe and orderly in 
2016 than in 2011, and 
that schools were less so 
in only 1 country. 
? — Principals reported 
3 5 % teachers found phe a hare 
SOMEWHAT ecrease in discipline 
safe and orderly Problems in 5 countries 
and an increase in two 
countries. 


Average Average 
Achievement Achievement 


517 502 


found LESS THAN 
safe and orderly 


oO of students were in 
3 Yo schools that teachers 
466 


Student Bullying 


Bullying has a negative association with 
student achievement. Media reports suggest 
that school-related cyberbullying is on the rise. 


Students’ Reports 


O of students said 
5 7 Yo they were NEVER 
or ALMOST NEVER 
bullied 


of students said 


% they were bullied 
about MONTHLY 
of students said 
% they were bullied 
about WEEKLY 


Average Average Average 
Achievement Achievement Achievement 


521 507 482 
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CHAPTER 7 


School Discipline and Safety 


Exhibit 7.1: School Discipline - Principals’ Reports 
Previous PIRLS assessments have asked principals for their perceptions about the degree to which 
a series of discipline, disorderly, and bullying behaviors are problems in their schools. Exhibit 
7.1 presents the PIRLS 2016 results for the School Discipline scale. Countries are ordered by the 
percentage of students whose principals reported few student discipline problems. Sixty-two percent 
of the fourth grade students, on average, attended schools where the principals reported Hardly 
Any Problems, another 30 percent attended schools with Minor Problems, and 8 percent attended 
schools with Moderate to Severe Problems. Average reading achievement was higher for students 
in schools with Hardly Any Problems than for those in schools with Minor Problems (518 vs. 
503). However, it was substantially lower—by 48 points—for students in schools with Moderate to 
Severe Problems (455). 

The trend results indicate that school discipline problems have not worsened since PIRLS 2011. 
Five countries showed fewer problems and two countries had an increase. 
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Exhibit 7.1: School Discipline - Principals' Reports 


Students Categorized by Principals' Reports 

Students were scored according to their principals’ responses concerning ten potential school problems on the School Discipline 
scale. Students in schools with Hardly Any Problems had a score on the scale of at least 9.9, which corresponds to their principals 
reporting “not a problem” for five of the ten issues and “minor problem” for the other five, on average. Students in schools with 
Moderate to Severe Problems had a score no higher than 7.7, which corresponds to their principals reporting “moderate 
problem’ for five of the ten issues and “minor problem” for the other five, on average. All other students attended schools with 
Minor Problems. 


Difference in 
Average Scale Score 


Moderate t 
Hardly Any Problems Minor Problems aplaodied 
Severe Problems 


Average 


Scale Score 
from 2011 


Countr 
y Percent Average Percent Average Percent Average 
of Students | Achievement | of Students | Achievement | of Students | Achievement 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Hong Kong SAR 93 (2.2) 571 (3.0) 7 (2.2) 547 (10.1) 0 (0. is 11.9 (0.10) 

Macao SAR 89 (0.1) 548 (1.1) 11 (0.1) 531 (3.4) 0 (0.0 a 11.4 (0.00) ae 
Northern Ireland r 85 (3.5) 566 (2.8) 15 (3.5) 557 (10.8) 0 (0.0 Bere 11.2 (0.12) =r 0.1 (0.17 
Kazakhstan 85 (3.1) 538 (2.8) 10 (2.7) 520 (9.2) 5 (1.6 537 (7.7) 11.4 (0.14) a2 
Lithuania 84 (2.5) 549 (2.9) 15 (2.4) 548 (5.6) 0 (0.5 aes 10.9 (0.10) 0.3 (0.15 
Ireland 83 (3.4) 571 (2.5) 15 (3.5) 550 (8.8) 2 (0.9 oa 11.0 (0.13) -0.1 (0.18 
England 82 (3.4) 563 (2.1) 18 (3.4) 539 (4.1) 0 (0.0 Aine 11.1 (0.11) 0.3 (0.18 
Finland 78 (3.3) 567 (1.9) 22 (3.3) 564 (4.9) 0 (0.0 oe 10.6 (0.09) 0.3 (0.15 
Chinese Taipei 77 (3.6) 560 (2.2) 23 (3.6) 557 (4.8) 0 (0.0 ae 11.1 (0.13) -0.3 (0.18 
Georgia 77 (3.0) 490 (3.1) 11 (2.3) 492 (8.6) 12 (2.3 479 (9.7) 10.6 (0.15) -0.3 (0.20 
Spain 76 (2.6) 531 (1.5) 18 (2.5) 520 (3.4) 6 (1.1 505 (16.2) 10.7 (0.12) 0.0 (0.20 
Czech Republic 75 (3.5) 545 (2.3) 23 (3.5) 539 (4.8) 1 (0.7 oy 10.4 (0.10) 0.1 (0.14) 
Azerbaijan 75 (3.4) 467 (5.4) 16 (2.8) 496 (7.2) 9 (2.2 461 (7.8) 10.5 (0.15) 0.9 (0.30) © 
United Arab Emirates 72 (2.1) 463 (4.5) 23 (2.0) 423 (6.3) 5 (1.0 392 (10.1) 10.7 (0.08) 0.7 (0.13) © 
Latvia 72 (4.0) 562 (2.1) 26 (4.3) 547 (4.2) 2 (13 um 10.5 (0.11) ae 

Bahrain 70 (2.7) 454 (3.1) 20 (2.6) 429 (6.4) 10 (0.9 424 (8.7) 10.2 (0.09) 22 
Norway (5) 70 (4.4) 562 (2.7) 28 (4.3) 554 (4.2) 2(1.1 sn 10.4 (0.14) = 

Russian Federation 70 (3.0) 580 (3.0) 30 (3.0) 583 (4.0) 0 (0.0 a 10.5 (0.08) 0.2 (0.12 
New Zealand 69 (3.4) 539 (3.0) 29 (3.4) 497 (6.2) 2 (1.0 Ree 10.6 (0.10) 0.0 (0.15 
Bulgaria 69 (4.1) 562 (4.5) 26 (3.8) 532 (9.6) 5 (2.1 521 (23.3) 10.4 (0.15) -0.2 (0.21 
Canada 68 (2.7) 550 (2.1) 31 (2.7) 532 (4.4) 2 (0.7 ee 10.4 (0.07) 0.1 (0.10 
Australia 67 (3.8) 556 (3.2) 29 (3.6) 525 (4.1) 4 (1.6 475 (12.3) 10.3 (0.11) -0.2 (0.16 
Singapore 67 (0.0) 580 (4.3) 33 (0.0) 569 (6.2) 0 (0.0 Aime 10.8 (0.00) 0.0 (0.00 
Slovak Republic 66 (3.7) 542 (3.0) 31 (3.8) 531 (7.5) 3 (1.5 420 (24.7) 10.4 (0.13) 0.3 (0.18 
Qatar 65 (0.4) 443 (2.5) 28 (0.3) 450 (2.7) 7 (0.1 403 (5.4) 10.5 (0.01) 0.4 (0.14) 0 
United States 65 (4.6) 561 (3.4) 31 (4.3) 529 (6.0) 4(15 520 (9.3) 10.4 (0.12) 0.0 (0.15 
Belgium (Flemish) 64 (3.7) 531 (2.4) 34 (3.7) 515 (4.9) 1 (0.9 nn 10.5 (0.14) Be 

Iran, Islamic Rep. of 63 (4.2) 443 (4.7) 30 (4.1) 406 (12.2) 7 (2.0 390 (16.2) 10.3 (0.12) -0.5 (0.16) @ 
Belgium (French) 63 (3.6) 503 (3.5) 33 (3.4) 495 (4.7) 5 (1.6 461 (12.4) 10.2 (0.11) 0.1 (0.19 
Malta 62 (0.1) 459 (2.1) 34 (0.1) 441 (2.5) 5 (0.1 446 (6.3) u 2 (0.00) 0.0 (0.01 

Italy 59 (3.6) 550 (3.0) 28 (3.4) 547 (4.5) 12 (2.5 543 (4.8) 9 (0.13) 0.3 (0.19 
Hungary 58 (4.2) 565 (3.6) 36 (4.1) 542 (5.5) 6 (1.7 a (9.4) a (0.12) 0.3 (0.18 
Slovenia 58 (4.0) 543 (3.1) 38 (3.7) 542 (2.9) 4(1.9 44 (8.6) 10.1 (0.14) 0.0 (0.18 
Portugal 57 (4.0) 534 (3.2) 38 (3.7) 523 (2.6) 6 (1.8 =n (10.2) 10.1 (0.10) -0.3 (0.20 
Israel 54 (3.9) 548 (5.2) 34 (3.5) 520 (6.4) 12 (2.1 475 (9.0) 9.6 (0.16) 0.5 (0.26 
Sweden 53 (4.6) 562 (3.3) 44 (4.6) 548 (4.0) 3 (1.1 522 (15.7) m (0.13) 0.3 (0.18 
France 52 (3.5) 519 (3.3) 41 (3.5) 508 (3.6) 7(1.9 484 (11.7) 9 (0.11) -0.4 (0.17) @ 
Denmark 52 (3.9) 552 (3.0) 47 (3.9) 543 (3.2) 1 (0.7 oa 7 (0.10) -0.1 (0.14 
Chile 52 (4.5) 506 (4.3) 37 (5.0) 490 (5.6) 11 (3.2 447 (10.4) 7 (0.13) ae 

Saudi Arabia 51 (3.7) 455 (5.8) 25 (3.1) 416 (8.0) 24 (3.6 393 (8.2) 35 (0.18) 0.2 (0.26 
Austria 51 (4.5) 548 (2.9) 45 (4.3) 536 (3.8) 4 (17 509 (12.4) 9.9 (0.12) 0.3 (0.18 
Netherlands 43 (5.1) 551 (2.9) 54 (5.2) 543 (2.5) 3 (1.0 498 (32.9) 9.6 (0.11) r+ 0.5 (0.15) O 
Germany 43 (3.8) 553 (2.8) 50 (3.7) 529 (5.1) 7 (2.0 489 (26.2) 9.4 (0.10) -0.2 (0.13 
Poland 42 (4.2) 569 (3.7) 57 (4.2) 562 (3.0) 1 (0.1 oy 9.7 (0.10) ae 

Oman 40 (2.6) 430 (5.1) 32 (2.8) 415 (5.5) 28 (2.9 407 (6.3) 8.9 (0.15) 0.4 (0.21 
Kuwait 37 (5.0) 413 (9.5) 41 (5.3) 388 (9.8) 23 (3.5 378 (12.0) 9.1 (0.14) Be 
Trinidad and Tobago 33 (3.9) 497 (7.2) 52 (4.4) 481 (6.0) 15 (3.4) 462 (10.6) 9.2 (0.12) -0.2 (0.17 
Egypt 19 (2.9) 356 (14.9) 39 (4.2) 336 (10.3) 42 (3.6 314 (8.7) 7.9 (0.13) 22 

South Africa r 18 (2.6) 348 (13.7) 55 (3.7) 319 (6.4) 27 (3.6 295 (7.9) 8.6 (0.10) 1 -0.3 (0.13 
Morecee 7 7 6) 368 "a ul 21 a 7 354 a . 62 (3.0 357 7 ; 74 (0.14) 0.2 (0.21 


This PIRLS questionnaire scale was established in 2011 based on the combined response distribution of all countries that Significantly higher than 2011 © 
participated in PIRLS 2011. To provide a point of reference for country comparisons, the scale centerpoint of 10 was located at 
the mean of the combined distribution. The units of the scale were chosen so that 2 scale score points corresponded to the 
standard deviation of the distribution. 


Significantly lower than 2011 @ 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A dash (-) indicates comparable data not available. A tilde (~) indicates insufficient data to report achievement. 
An “r" indicates data are available for at least 70% but less than 85% of the students. 
Z TIMSS & FIRLS — 
nternational Study Center 
Zw I EA Lynch School of Education 
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Exhibit 7.1: School Discipline - Principals' Reports (Continued) 


‘ Moderate to 
Hardly Any Problems Minor Problems eceprcieae 
oun Percent Average Percent Average Percent Average 


Benchmarking Participants 


Dubai, UAE 83 (0.2) 
Madrid, Spain 79 (3.3) 
Andalusia, Spain 76 (3.5) 
Moscow City, Russian Fed. 72 (3.8) 
Ontario, Canada 71 (4.5) 
Quebec, Canada 69 (4.7) 
Norway (4) 66 (4.4) 
Abu Dhabi, UAE 66 (3.4) 
Denmark (3) 54 (4.2) 
Buenos Aires, Argentina 42 (3.6) 


Eng/Afr/Zulu-RSA(5) —sr_~—25 (4.4) 


521 (2.1) 
552 (2.3) 
528 (2.1) 
614 (2.5) 
552 (3.6) 
552 (3.3) 
520 (2.5) 
426 (6.9) 
505 (3.5) 
495 (6.2) 
421 (14.4) 


sa. 


i ag 
26 (4.3) 
31 (4.7) 
30 (4.3 
27 (2.9 
44 (4.1) 
50 (3.9 
57 (5.1 


496 (4.5) 
534 (3.9) 
516 (4.6) 
608 (4.8) 
530 (5.4) 
537 (6.9) 
514 (3.6) 
395 (7.9) 
497 (4.1) 
475 (4.7) 
412 (11.0) 


3 (0.1) 
2 (1.3) 
6 (2.0) 
0 (0.0) 

3 (1.4) 
0 (0.0) 
3 (1.1) 
7 (2.1) 

2 (0.9) 
8 (2.0) 

17 (4.2) 


439 (7.9) 


506 (18.6) 


490 (19.7) 
505 (7.7) 
385 (14.3) 
450 (12.8) 
393 (16.1) 


Average 
Scale Score 


11.2 (0.01) 
10.9 (0.13) 
10.6 (0.15) 
10.3 (0.09) 
10.5 (0.14) 
10.5 (0.15) 
10.4 (0.13) 
10.3 (0.13) 
10.1 (0.12) 
9.5 (0.10) 
8.9 (0.16) 


Significantly higher than 2011 @ 


Difference in 
Average Scale Score 


from 2011 


0.5 (0.01) © 


0.2 (0.24) 
0.2 (0.21 
0.5 (0.19 
0.3 (0.18 
0.3 (0.22 


) 
) 
) 
) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Significantly lower than 2011 @ 


To what degree is each of the following a problem among fourth grade students in your school? 


Intimidation or verbal abuse among students 
(including texting, emailing, etc.) 
9) Physical fights among students 


10) Intimidation or verbal abuse of teachers or staff 


(including texting, emailing, etc.) 
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Nota 
problem 


Hardly Any 
Problems 


ee) 


Minor 
problem 


Minor 
Problems 


f 


Tell 


Moderate 
problem 


Moderate to 


Serious 
problem 


Severe Problems 
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Exhibit 7.2: Safe and Orderly School - Teachers’ Reports 
To develop the Safe and Orderly School scale, PIRLS 2016 asked teachers about their degree of 
agreement with eight statements such as “I feel safe at this school” and “This school has clear rules 
about student conduct.” Exhibit 7.2 presents the percentages of students in schools categorized 
according to teachers’ judgments about safety. There was considerable variation, but on average, 
most fourth grade students (62%) were in schools judged by their teachers to be Very Safe and 
Orderly and nearly all the rest (35%) were in schools judged Somewhat Safe and Orderly. Only 
3 percent, on average, were attending schools felt to be Less than Safe and Orderly. There was a 
direct positive association between safe and orderly schools and average reading achievement (517, 
502, and 466, respectively). 

Teachers’ reports indicate that schools may be safer in 2016 than they were in 2011. Average 

scores on the Safe and Orderly School scale increased in 16 countries and only decreased in 1 country. 
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Grad 
Exhibit 7.2: Safe and Orderly School - Teachers' Reports 2016 cD ia 


Students Categorized by Teachers’ Reports 


Students were scored according to their teachers’ degree of agreement with eight statements on the Safe and Orderly School scale. 
Students in Very Safe and Orderly schools had a score on the scale of at least 9.9, which corresponds to their teachers “agreeing a 
lot” with four of the eight qualities of a safe and orderly school and “agreeing a little” with the other four, on average. Students in 
Less than Safe and Orderly schools had a score no higher than 6.6, which corresponds to their teachers “disagreeing a little” with 
four of the eight qualities and “agreeing a little” with the other four, on average. All other students attended Somewhat Safe and 
Orderly schools. 


Difference in 


Very Safe and Orderly Somewhat Safe and Orderly | Less than Safe and Orderly 
Average 


Average Scale Score 


Scale Score 
from 2011 


Country Percent Average Percent Average Percent Average 
of Students | Achievement | of Students | Achievement a Achievement 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Kazakhstan 92 (2.2) 536 (2.5) 12.4 (0.10) _ 
Georgia 88 (2.3) 491 (3.2) ‘ ce 2 os 11.7 (0.11) 0.6 (0.17) © 
Azerbaijan ts (2.7) 473 (4.7) ' “a x 1 (0.4 “~ 11.5 (0.13) 0.2 (0.18 
Northern Ireland 83 (3.0) 567 (2.6) 16 (3.1 547 (7.3 1 (0.9) ws 12.1 (0.14) + 0.7 (0.19) © 
England 82 (2.7) 562 (2.4) 17 (2.7 543 (4.4 0 (0.5 ~~ 11.5 (0.12) 0.7 (0.18) © 
Israel 80 (2.9) 531 (3.0) 17 (2.9 532 (9.4 2 (1.2 os 11.2 (0.16) 0.2 (0.22 
Norway (5) 80 (2.8) 562 (2.4) 19 (2.6 549 (5.5 1 (0.8) ~~ 11.3 (0.14) ne 
Qatar 80 (1.9) 444 (2.6) 19 (1.9 432 (9.5 1 (0.5 a os 11.4 (0.09) 0.8 (0.16) © 
Ireland 79 (2.9) 570 (3.0) 19 (2.8 555 (4.8 2 (1.0) ~~ 11.6 (0.15) 0.4 (0.21) 
Australia 78 (3.0) 551 (2.9) 20 (3.0 526 (5.9 2 (0.6) oo 11.4 (0.14) +r 04 (0.21 
Netherlands 78 (3.6) 549 (2.2) 21 (3.7 535 (4.5 1(11 “_~ 11.1 (0.13) 0.3 (0.20 
New Zealand 77 (2.4) 536 (2.4) 21 (2.3 497 (6.1 2 (0.8 ae 11.4 (0.12) 0.5 (0.17) © 
Oman 76 (2.7) 421 (3.7) 23 (2.7 411 (7.4 0 (0.2 ~~ 11.0 (0.11) 1.0 (0.14) © 
Spain 76 (3.1) 532 (1.8) 23 (3.0 517 (4.0 2 (0.8 oo 11.2 (0.13) 1.7 (0.20) O 
Macao SAR 75 (0.1) 548 (1.2) 23 (0.1 535 (2.2 2 (0.0) ad 10.9 (0.00) oS 
Portugal 72 (3.4) 532 (2.8) 26 (3.3 519 (3.6 2 (0.9) oo oS 10.9 (0.13) 14 (0.23) O 
Kuwait 71 (3.8) 398 (5.0) 29 (3.8 387 (9.2 0 (0.1 oS 10.7 (0.16) _ 
United Arab Emirates 71 (2.1) 469 (3.9) 28 (2.0 411 (5.6 1 (0.7 mo 11.0 (0.09) 0.2 (0.12 
Bulgaria 68 (3.7) 563 (4.7) 31 (3.6 530 (8.4) 1 (0.6 “~ 10.3 (0.13) 0.4 (0.19 
Saudi Arabia 68 (3.6) 439 (4.6) 29 (3.5 414 (10.9) 3 (1.3) 385 (13.1 10.8 (0.14) 0.7 (0.20) © 
Singapore 67 (2.1) 578 (4.1) 30 (2.1 573 (5.5 2 (0.6) ae 10.8 (0.09) 0.5 (0.13) © 
Iran, Islamic Rep. of 66 (3.8) 433 (4.9) 30 (3.7 417 (10.1) 4 (14) 425 (35.4) 10.6 (0.14) 0.4 (0.20 
Egypt 63 (4.1) 340 (7.3) 35 (4.0 313 (10.4) 2 (1.0 ~~ 10.5 (0.16) ae 
Hong Kong SAR 63 (4.5) 571 (3.6) 36 (4.6 565 (4.7 1 (0.9 a oe 10.5 (0.17) 0.6 (0.24) 
Bahrain 62 (3.2) 460 (3.2) 34 (3.2 422 (5.2 3 (1.4) 420 (16.2 10.7 (0.13) -- 
United States 62 (3.9) 563 (3.3) 30 (3.6 531 (7.1 8 (2.1 517 (8.8) 10.3 (0.19) 0.0 (0.21 
Austria 62 (4.0) 547 (2.7) 36 (3.9 532 (4.0 1 (07 ws 10.3 (0.13) 0.4 (0.18 
Canada 62 (2.3) 548 (2.1) 36 (2.2 538 (2.7 3 (0.8 497 (16.8 10.6 (0.11) 0.2 (0.17 
Lithuania 60 (3.8) 550 (2.7) 40 (3.8 549 (4.4 1 (0.8 oar 10.2 (0.13) 0.6 (0.18) © 
Russian Federation 59 (3.2) 581 (3.2) 40 (3.3 580 (4.0 1 (0.7 oo 10.2 (0.12) 0.5 (0.21 
Slovak Republic 58 (3.1) 542 (3.8) 38 (3.2 530 (5.0 3 (1.1 472 (344) 10.0 (0.11) 0.7 (0.13) © 
Poland 57 (4.3) 566 (3.1) 42 (4.3 562 (3.1 1 (0.5 a oe 10.0 (0.13) ai 
Denmark 56 (4.0) 554 (2.9) 40 (3.9 539 (3.2 4(15 546 (8.2) 10.1 (0.16) -0.4 (0.20) 
Latvia 56 (3.8) 559 (2.6) 43 (3.9 556 (3.0 1 (0.8 mo 9.8 (0.11) os 
Czech Republic 53 (3.2) 548 (2.4) 45 (3.3 541 (3.2 2 (0.9 “~ 9.8 (0.10) 0.3 (0.16 
Chile 52 (4.4) 510 (4.4) 41 (4.4) 491 (4.1 7 (2.5 435 (11.3 10.0 (0.20) eS 
Hungary 51 (3.9) 563 (4.8) 46 (4.0 548 (4.5 3 (1.5 497 (18.2 9.7 (0.13) 0.0 (0.18) 
Germany 48 (3.8) 554 (3.2) 48 (3.7 524 (5.8 4(17 461 (29.5 9.8 (0.13) 0.2 (0.17 
Morocco 48 (3.3) 385 (5.9) 43 (3.3 333 (5.5 9 (1.8 333 (7.9) 9.8 (0.15) 1.2 (0.21) O 
Sweden 47 (3.9) 564 (3.4) 49 (3.8 551 (3.0 4(13 512 (12.4 9.9 (0.16) 0.4 (0.22 
South Africa tr 47 (3.7) 326 (8.2) 43 (3.7 319 (8.2 11 (1.9) 314 (13.9 9.6 (0.16) +r 0.6 (0.20) © 
Chinese Taipei 46 (4.2) 554 (2.8) 52 (4.2 563 (2.7 2 (1.0) 2 63 9.7 (0.15) 0.8 (0.21) © 
Belgium (Flemish) 45 (3.8) 533 (2.3) 52 (3.7 521 (3.1 3 (1.1 488 (12.0 9.5 (0.12) en 
Malta 44 (0.1) 459 (2.5) 47 (0.2 449 (2.2 9 (0.1 436 (5.6) 9.6 (0.01) + -0.4 (0.01) @ 
Belgium (French) 40 (3.7) 507 (3.7) 51 (3.8 496 (3.7 9 (2.0) 466 (10.0 9.2 (0.14) 0.4 (0.22) 
Finland 40 (3.5) 569 (2.7) 52 (3.5 565 (2.7 7 (1.6 559 (4.9) 9.4 (0.11) 0.2 (0.17 
France 40 (3.2) 521 (4.2) 57 (3.4 507 (3.2 4(11 482 (7.2) 9.5 (0.13) 0.1 (0.17 
Trinidad and Tobago 38 (4.1) 493 (6.6) 48 (4.0 474 (4.8 14 (2.4 464 (11.7 9.1 (0.19) 0.7 (0.27) © 
Slovenia 21 (3.1) 545 (4.2) : 7 - 7 8 (1.8 555 (5.6) 8.7 (0.13) -0.1 (0.17) 
Italy 20 (3.0) 556 7 I : ; -1 523 7 7 8.8 (0.11) 0.2 (0.14) 

This PIRLS questionnaire scale was established in 2011 based on the combined response distribution of all countries that Significantly higher than 2011 © 

participated in PIRLS 2011. To provide a point of reference for country comparisons, the scale centerpoint of 10 was located at Significantly lower than 2011 @ 


the mean of the combined distribution. The units of the scale were chosen so that 2 scale score points corresponded to the 
standard deviation of the distribution. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A dash (-) indicates comparable data not available. A tilde (~) indicates insufficient data to report achievement. 
An “r" indicates data are available for at least 70% but less than 85% of the students. 
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Exhibit 7.2: Safe and Orderly School - Teachers' Reports (Continued) 


Country 


Very Safe and Orderly Somewhat Safe and Orderly | Less than Safe and Orderly P Difference in 
verage 


Percent Average Percent Average Percent Average GalloGae Average Scale Score 
of Students | Achievement | of Students | Achievement | of Students | Achievement from 2011 


Benchmarking Participants 


Andalusia, Spain 


81 (2.9) 530 (2.0) 15 (2.9) 502 (8.1) 4 (15) 488 (7.9) 11.3 (0.16) 2.0 (0.23) O 


Dubai, UAE 78 (2.1) 529 (2.5) 21 (2.1) 474 (6.7) 1 (0.3) oe 11.4 (0.09) 0.2 (0.12) 
Madrid, Spain 78 (3.5) 553 (2.3) 22 (3.5) 536 (3.7) 0 (0.0) es 11.4 (0.17) ae 
Norway (4) 72 (3.5) 517 (2.4) 27 (3.4) 516 (3.8) 2 (1.0) ie 10.8 (0.14) 0.3 (0.21) 
Buenos Aires, Argentina 67 (3.1) 491 (3.9) 28 (3.2) 457 (6.7) 4 (1.6) 446 (18.1) 10.5 (0.15) =e 
Abu Dhabi, UAE 64 (3.8) 430 (6.2) 35 (3.8) 390 (9.3) 1 (0.7) me ee 10.5 (0.15) -0.2 (0.21) 
Ontario, Canada 62 (4.1) 552 (3.7) 33 (4.1) 534 (5.0) 5 (1.7) 512 (16.3) 10.5 (0.19) 0.5 (0.27) 
Moscow City, Russian Fed. 60 (3.9) 612 (3.1) 39 (4.0) 614 (3.2) 2 (1.0) ey oe 10.2 (0.14) ee 
Eng/Aft/Zulu - RSA (5) r 55 (6.1) 419 (11.5) 37 (5.7) 400 (9.8) 8 (3.6) 437 (33.7) 10.0 (0.31) =e 
Denmark (3) 51 (3.6) 505 (3.7) 45 (3.6) 496 (4.0) 3 (1.5) 508 (17.5) 10.0 (0.15) z= 
Quebec, Canada 44 (4.8) 547 (4.4) 56 (4.8) 547 (3.6) 0 (0.1) pees 9.8 (0.17) 0.1 (0.24) 
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Significantly higher than 2011 © 
Significantly lower than 2011 @® 


Thinking about your current school, indicate the extent to which you agree or disagree with each 


of the following statements. 
Agree a lot Agree a little Disagree Disagree 
alittle alot 


1) This school is located in a safe neighborhood 
2) | feel safe at this school 


3) This school’s security policies and practices 
are sufficient 


4) The students behave in an orderly manner 

5) The students are respectful of the teachers 

6) The students respect school property 

7) This school has clear rules about student conduct ---- O ——= O ——= O —— O 


8) This school’s rules are enforced in a fair 
and consistent manner 


Very Somewhat i Less than Safe 


Safe and Safe and 
Orderly oo Orderly ¢¢ 


and Orderly 
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Exhibit 7.3: Student Bullying 


Exhibit 7.3 summarizes students’ responses about how often they were bullied in school. On average 
across the PIRLS 2016 countries, the majority of fourth grade students (57%) reported Almost Never 
being bullied. However, 29 percent reported they were bullied on a Monthly basis, and 14 percent on 
a Weekly basis. There were a number of countries where 20 percent or more of the students reported 
being bullied weekly. Fourth grade students’ reports about being bullied were directly related to their 
average reading achievement, with each successive category of increased bullying being related to 
a decrease in average reading achievement (521 average for Almost Never, 507 for Monthly, and 
482 for Weekly—for a decrease of 39 points overall). 
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Exhibit 7.3: Student Bullying 


Students' Reports 


Students were scored according to their responses to how often they experienced eight bullying behaviors on the Student Bullying 
scale. Students bullied Almost Never had a score on the scale of at least 9.5, which corresponds to “never” experiencing four of 
the eight bullying behaviors and experiencing each of the other four behaviors “a few times a year,” on average. Students bullied 
About Weekly had a score no higher than 7.9, which corresponds to their experiencing each of four of the eight behaviors “once 
or twice a month” and each of the other four “a few times a year,” on average. All other students were bullied About Monthly. 


About Monthly About Weekly 
c Average 
OMnisy Percent Average Percent Average Percent Average Scale Score 
of sae Achievement of Students Achievement of see Achievement 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Kazakhstan 540 ta 17 (0.8) 527 (3.7) 519 (5.8) 11.2 (0.07) 
Finland = : . 571 (1.9) 21 (0.9) 557 (3.4) : . 7 532 (6.1) 10.7 (0.05) 
Ireland 74 (1.1) 575 (2.3) 20 (0.9) 551 (3.8) 5 (0.5) 526 (7.6) 10.8 (0.05 
Norway (5) 74 (1.0) 564 (2.3) 21 (0.8) 552 (3.8) 5 (0.4) 524 (6.5) 10.6 (0.05 
Georgia 74 (1.4) 497 (2.8) 18 (1.0) 484 (4.0) 8 (0.6) 439 (5.9) 10.9 (0.06) 
Egypt 73 (2.0) 337 (5.9) 18 (1.5) 325 (8.1) 9 (1.0) 294 (13.5) 10.9 (0.10) 
Poland 72 (1.0) 573 (2.0) 20 (0.8) 550 (3.6) 7 (0.5) 523 (6.4) 10.7 (0.04 
Azerbaijan 72 (1.2) 483 (4.2) 20 (0.8) 469 (4.1) 8 (0.6) 429 (6.7) 10.9 (0.06 
Sweden 71 (1.0) 562 (2.7) 23 (0.7) 547 (2.9) 6 (0.5) 526 (6.3) 10.5 (0.05) 
Denmark 67 (1.2) 552 (2.2) 27 (0.9) 543 (3.4) 7 (0.6) 526 (5.3) 10.3 (0.05) 
Iran, Islamic Rep. of 66 (1.9) 430 (4.8) 23 (1.2) 430 (7.4) 10 (1.0) 417 (6.6) 10.6 (0.11 
France 66 (1.2) 518 (2.2) 26 (0.9) 506 (3.8) 8 (0.6) 476 (5.3) 10.4 (0.06 
Chile 64 (1.2) 506 (2.4) 23 (0.9) 493 (3.7) 13 (0.8) 448 (4.7) 10.3 (0.05) 
Austria 63 (1.0) 549 (2.4) 27 (0.9) 535 (3.3) 11 (0.6) 512 (4.0) 10.2 (0.04) 
Czech Republic 62 (1.0) 549 (2.5) 28 (0.8) 541 (2.5) 10 (0.5) 517 (4.5) 10.3 (0.04 
Chinese Taipei 62 (1.1) 565 (2.4) 27 (0.8) 554 (2.7) 11 (0.5) 540 (3.8) 10.3 (0.05 
Portugal 60 (1.0) 533 (2.5) 28 (0.9) 525 (2.9) 12 (0.7) 509 (4.4) 10.2 (0.05) 
Hungary 60 (1.2) 563 (3.1) 31 (0.9) 546 (3.8) 9 (0.7) 524 (5.8) 10.0 (0.04) 
Hong Kong SAR 60 (1.4) 575 (2.6) 29 (1.1) 563 (4.2) 11 (0.7) 551 (4.8) 10.0 (0.05 
Lithuania 60 (1.4) 560 (2.8) 30 (1.1) 537 (4.0) 11 (0.7) 519 (4.8) 10.0 (0.06 
Northern Ireland 59 (1.3) 576 (2.6) 29 (1.0) 557 (2.9) 11 (0.8) 531 (5.7) 10.0 (0.06) 
Netherlands 58 (1.1) 548 (2.0) 31 (0.9) 546 (2.3) 10 (0.6) 525 (3.7) 9.9 (0.04) 
Germany 57 (1.1) 553 (2.9) 32 (0.9) 537 (2.8) 11 (0.6) 510 (5.7) 10.0 (0.04 
Slovak Republic S7 (1,2) 543 (3.4) 29 (1.1) 534 (3.5) 14 (0.8) 502 (6.1) 10.0 (0.05 
Morocco 57 (1.8) 373 (4.1) 29 (1.0) 347 (5.2) 14 (1.0) 325 (7.5) 10.1 (0.08) 
Bulgaria 56 (1.8) 561 (5.0) 30 (1.2) 546 (4.3) 14 (1.0) 528 (6.6) 9.9 (0.07) 
Slovenia 56 (1.1) 548 (2.3) 29 (0.8) 546 (2.6) 15 (0.7) 517 (4.4) 9.8 (0.04 
United States 56 (1.2) 561 (3.4) 30 (0.9) 549 (3.3) 15 (0.7) 521 (4.6) 9.9 (0.05 
Italy 55 (1.0) 554 (2.5) 31 (0.8) 544 (2.9) 14 (0.7) 538 (3.9) 9.9 (0.04) 
Spain 54 (0.8) 536 (1.4) 31 (0.7) 524 (2.6) 15 (0.6) 506 (4.2) 9.9 (0.03) 
Malta 54 (0.7) 468 (2.0) 30 (0.7) 445 (3.5) 16 (0.5) 418 (5.0) 9.8 (0.03 
Saudi Arabia 53 (1.8) 453 (4.5) 2501 432 (5.5) 22013) 385 (6.9) 9.9 (0.09 
Belgium (Flemish) 52 (1.2) 531 (2.3) 34 (1.0) 523 (2.6) 13 (0.6) 508 (3.0) 9.7 (0.05) 
England 52 (1,2) 569 (2.3) 33 (0.9) 558 (2.5) 15 (0.7) 531 (3.8) 9.7 (0.04) 
Russian Federation 52 (1.4) 588 (2.7) 34 (1.1) 578 (2.6) 14 (0.8) 565 (3.5) 9.8 (0.06 
Singapore 50 (0.7) 590 (3.2) 33 (0.7) 572 (3.2) 16 (0.5) 543 (4.8) 9.6 (0.03 
Canada 50 (0.8) 554 (1.9) 33 (0.7) 539 (2.1) 16 (0.7) 521 (3.3) 9.7 (0.03) 
Oman 48 (1.7) 437 (4.1) 32 (1.0) 417 (3.7) 20 (1.0) 387 (4.5) 9.7 (0.08) 
Kuwait 47 (1.8) 410 (4.2) 37 (1.5) 391 (5.8) 16 (0.9) 367 (8.8) 9.6 (0.07 
Australia 46 (1.1) 557 (3.4) 35 (1.0) 544 (2.7) 19 (0.7) 519 (4.6) 9.5 (0.04 
Latvia 44 (1.2) 568 (2.2) 35 (1.0) 559 (2.3) 20 (0.9) 534 (3.1) 9.4 (0.04) 
United Arab Emirates 43 (0.8) 477 (3.5) 32 (0.5) 454 (4.0) 25 (0.7) 408 (4.4) 9.4 (0.04) 
Qatar 43 (1.3) 469 (2.3) 32 (0.6) 448 (3.0) 26 (0.9) 402 (4.2) 9.4 (0.06 
Macao SAR 42 (0.7) 555 (1.5) 42 (0.7) 541 (1.6) 16 (0.6) 532 (3.4) 9.3 (0.02 
Belgium (French) 42 (1.1) 505 (3.0) 38 (0.8) 497 (2.7) 20 (0.9) 484 (4.2) 9.3 (0.04) 
New Zealand 40 (1.0) 541 (2.9) 36 (0.7) 525 (3.0) 24 (0.8) 494 (3.4) 9.2 (0.04) 
Trinidad and Tobago 37 (1.5) 494 (3.6) 36 (1.0) 478 (4.2) 27 (1,4) 462 (4.7) 9.2 (0.07 
Bahrain 36 (1.1) 470 (3.3) 32 (0.7) 451 (3.5) 32 (1.0) 417 (3.4) 9.1 (0.05 
South Africa 22 (0.8) 349 (5.9) 35 (0.7) 332 (4.4) 42 (1.0) 299 (4.5) 8.4 (0.04) 
Israel -- 


International Avg. BY (74) BYR () PEA \)) BIA ()) 14 (0.1) 482 (0.8) 


This PIRLS questionnaire scale was established in 2016 based on the combined response distribution of all countries that participated in PIRLS 2016. To provide a point of 
reference for country comparisons, the scale centerpoint of 10 was located at the mean of the combined distribution. The units of the scale were chosen so that 2 scale score 
points corresponded to the standard deviation of the distribution. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A dash (-) indicates comparable data not available. 
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Exhibit 7.3: Student Bullying (Continued) 


Almost Never 


Country Percent Average Percent Average Percent Average Scale Score 
of Students Achievement of Students Achievement of Students Achievement 


Benchmarking Participants 


Norway (4) 69 (1.1) 
Denmark (3) 58 (1.1) 
Madrid, Spain 56 (1.2) 
Quebec, Canada 55 (1.5) 
Andalusia, Spain 53 (1.2) 
Dubai, UAE 48 (1.2) 
Moscow City, Russian Fed. 47 (1.2) 
Ontario, Canada 47 (1.3) 
Buenos Aires, Argentina 45 (1.2) 
Abu Dhabi, UAE 38 (1.7) 
Eng/Afr/Zulu - RSA (5) 27 (1.6) 


522 (2.2) 
510 (3.0) 
554 (2.3) 
553 (3.2) 
533 (2.4) 
532 (2.2) 
621 (2.4) 
557 (3.6) 
494 (3.5) 
444 (6.2) 
439 (6.4) 


About Monthly 


24 (1.0) 
32 (1.0) 
31 (0.9) 
33 (1.2) 
32 (0.9) 
32 (0.6) 
35 (0.8) 
35 (1.6) 
36 (1.0) 
32 (1.0) 
39 (1.1) 


513 (3.1) 
495 (3.4) 
547 (2.5) 
546 (3.5) 
518 (2.4) 
518 (2.4) 
609 (2.3) 
541 (3.7) 
486 (3.6) 
424 (5.6) 
413 (6.5) 


About Weekly 


7 (0.5) 
10 (0.7) 
13 (0.6) 
13 (0.9) 
15 (0.8) 
20 (0.9) 
18 (0.9) 
18 (1.3) 
18 (0.7) 
30 (1.7) 
34 (1.7) 


492 (4.7) 
471 (6.3) 
531 (3.1) 
531 (4.4) 
511 (3.3) 
478 (4.0) 
596 (3.7) 
521 (4.6) 
453 (4.4) 
376 (6.0) 
379 (6.1) 


During this school year, how often have other students from your school done any of the following 
things to you (including through texting or the Internet)? 


1) Made fun of me or called me names 


2) Left me out of their games or activities 
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Never 


Afewtimes Onceortwice Atleast 
once a week 


a year 


About 
Monthly 


amonth 


t About Weekly 


ZF 
iF 


Average 


10.5 (0.05) 
10.1 (0.05 


) 
10.0 (0.05) 
9.9 (0.06) 
9.9 (0.05) 
9.6 (0.04) 
9.5 (0.05) 
9.5 (0.05) 
9.6 (0.05) 
9.1 (0.09) 
8.7 (0.07) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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READING-FOURTH GRADE PIRLS 
2016 


Students Have Well Qualified Teachers and Principals 


Teachers’ Preparation and Experience 
Internationally, teachers of fourth grade students reported high levels of education 
and considerable experience. 


of students were taught of students were taught 
by teachers with at least by teachers with an 
a Bachelor’s degree advanced degree 


42% 


of students were taught by teachers with at least 20 years of experience 
(on average, students’ teachers had 17 years of experience). 


Principals’ Preparation and Experience 
Internationally, principals of fourth grade students reported high levels of education 
and considerable experience. 


O35 Agee 


of students had principals with of students had principals 
at least a Bachelor's degree with an advanced degree 


to have teaching experience in 41 countries, but completion of a 


) On average, principals had 10 years of experience. They were required 
specialized leadership program was less common (28 countries). 


F : ; TIMSS & PIRLS 
SOURCE: IEA's Progress in International Reading { 1 EA International Study Center 


Literacy Study — PIRLS 2016 w Lynch School of Education 
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CHAPTER 8 


Teachers’ and Principals’ Preparation 


Exhibit 8.1 and 8.2: Teachers’ Formal Education 


Exhibit 8.1 presents teachers’ reports about their highest level of formal education. On average, 26 
percent of the fourth grade students had teachers with a postgraduate university degree, 60 percent 
had teachers with a bachelor’s degree (or equivalent) but not a postgraduate degree, 11 percent had 
teachers with post-secondary education but not a bachelor’s degree, and 3 percent had teachers with 
an upper-secondary degree. 

Exhibit 8.2 presents the percentages of students whose teacher had various areas of specialization 
in their formal education. Seventy percent of the students had teachers whose education included 
an emphasis on language, 64 percent had teachers with an emphasis on pedagogy/teaching reading, 
and 32 percent had teachers with an emphasis on reading theory. The PIRLS results do not show any 
relationship between emphasis on these specializations and students’ average reading achievement. 
This was consistent across the three areas of emphasis (language, pedagogy, and reading theory). 
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Exhibit 8.1: Teachers' Formal Education* 


Students Categorized by Teachers' Reports 


Percent of Students by Teacher Education Level 


Completed 
Bachelor's Degree or 
Equivalent but Nota 
Postgraduate Degree 


Completed 
Post-Secondary 
Education but Not a 
Bachelor's Degree 


No Further than 
Upper-Secondary 
Education 


Completed 
Postgraduate 
University Degree** 


Country 


Australia 12 (2.3) 82 (2.8) 7 (2.0) 0 (0.0) £ 
Austria 5 (1.2) 26 (3.0) 68 (2.9) 0 (0.3) 2 
Azerbaijan 12 (2.6) 46 (3.9) 41 (3.8) 1 (0.6) g 
Bahrain 17 (3.5) 81 (3.6) 1 (0.5) 1 (0.7) z 
Belgium (Flemish) 2 (0.8) 96 (1.2) 2 (0.8) 0 (0.4) 2 
Belgium (French) 2 (0.9) 98 (1.0) 0 (0.0) 0 (0.4) § 
Bulgaria 76 (3.0) 18 (2.7) 6 (1.6) 0 (0.0) = 
Canada 16 (1.8) 84 (1.8) 0 (0.0) 0 (0.0) 4 
Chile 10 (2.5) 65 (4.3) 25 (3.9) 0 (0.0) 3 
Chinese Taipei 42 (4.1) 58 (4.1) 0 (0.0) 0 (0.0) » 
Czech Republic 92 (1.5) 2 (0.7) 2 (0.7) 5 (1.1) 7 
Denmark 4 (1.5) 79 (3.0) 5a (257) 2 (1.0) S 
Egypt 1 (0.8) 71 3.9) 24 (3.8) 3 (1.1) 3 
England 8 (2.2) 92 (2.1) 0 (0.0) 0 (0.3) 
Finland 92 (1.8) 6 (1.5) 1 (0.5) 1 (0.4) 
France 42 (4.0) 44 (3.8) 11 (2.4) 20.1) 
Georgia 82 (2.9) 9 (2.2) 9 (2.1) 0 (0.0) 
Germany 90 (2.2) 2 (1.2) 7 (1.9) 0 (0.5) 
Hong Kong SAR 37 (3.5) 59 (3.5) 4 (1.7) 0 (0.0) 
Hungary 5 (1.7) 95 (1.8) 0 (0.2) 0 (0.0) 
Iran, Islamic Rep. of 5 (1.5) 58 (4.1) 26 (3.1) 11 (2.8) 
Ireland 26 (3.6) 74 (3.6) 0 (0.0) 0 (0.0) 
Israel 34 (3.9) 61 (3.9) 4 (1.3) 0 (0.0) 
Italy 2 (1.1) 16 (2.6) 19 (2.9) 63 (3.8) 
Kazakhstan 1 (0.7) 84 (2.7) 12 (2.3) 3 (1.1) 
Kuwait 9 (2.5) 89 (2.7) 2 (1.0) 0 (0.3) 
Latvia 51 (4.1) 44 (4.2) 4 (1.6) 1 (0.2) 
Lithuania 27 (3.6) 70 (3.8) 3 (1.2) 0 (0.0) 
Macao SAR 9 (0.1) 81 (0.1) 9 (0.0) 1 (0.0) 
Malta 7 (0.1) 84 (0.1) 6 (0.1) 3 (0.1) 
Morocco 0 (0.4) 42 (3.4) 13 (2.4) 44 (3.5) 
Netherlands 4 (1.4) 91 (2.1) 4 (1.4) 1 (0.7) 
New Zealand 5 (1.3) 82 (2.4) 13 (2.3) 0 (0.0) 
Northern Ireland 19 (3.4) 80 (3.5) 1 (0.7) 0 (0.0) 
Norway (5) 22 (3.2) 73 (3.2) 4 (1.4) 0 (0.3) 
Oman 11 (1.8) 73 (3.1) 12 (2.4) 3 (1.0) 
Poland 100 (0.3) 0 (0.0) 0 (0.3) 0 (0.0) 
Portugal 13 (2.5) 83 (2.7) 5 (1.2) 0 (0.0) 
Qatar 25 (2.0) 71 (2.1) 3 (0.7) 1 (0.6) 
Russian Federation 43 (3.5) 37 (3.3) 19 (2.6) 0 (0.0) 
Saudi Arabia 4 (17) 77 (3.6) 13 (2.7) 6 (1.8) 
Singapore 9 (1.5) 72 (2.7) 18 (2.4) 1 (0.5) 
Slovak Republic 98 (1.3) 2 (1.1) 1 (0.7) 0 (0.0) 
Slovenia 2 (0.9) 62 (3.2) 36 (3.2) 0 (0.0) 
South Africa r 1 (0.9) 46 (4.0) 45 (3.9) 7 (1.8) 
Spain 24 (2.9) 76 (2.9) 0 (0.1) 0 (0.0) 
Sweden 13 (2.8) 81 (3.1) 5 (1.7) 0 (0.2) 
Trinidad and Tobago 9 (2.2) 62 (4.0) 24 (3.5) 5 (1.9) 
United Arab Emirates 22 (2.4) 71 (2.1) 7 (1.6) 0 (0.0) 
United States 55 (4.0) 45 (4.0) 0 (0.0) 0 (0.0) 

30) 


* Based on countries’ categorizations according to UNESCO's International Standard Classification of Education (Operational Manual for ISCED-2011). 


** For example, doctorate, master’s, or other postgraduate degree. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
An “r" indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are available for at least 50% but less than 70% of the students. 
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Exhibit 8.1: Teachers' Formal Education* (Continued) 


Percent of Students by Teacher Education Level 


Country 


Benchmarking Participants 


Buenos Aires, Argentina 
Ontario, Canada 

Quebec, Canada 

Denmark (3) 

Norway (4) 

Moscow City, Russian Fed. 
Eng/Afr/Zulu - RSA (5) s 
Andalusia, Spain 

Madrid, Spain 

Abu Dhabi, UAE 

Dubai, UAE 


Downloaded from http://pirls2016.org/download-center/ 


Completed 
Postgraduate 
University Degree** 


Completed 


Bachelor's Degree or 
Equivalent but Nota 
Postgraduate Degree 


12 (2.7) 
85 (3.1) 
87 (3.4) 
81 (3.6) 
75 (3.4) 
33 (3.8) 
55 (5.9) 
82 (2.7) 
72 (4.3) 
78 (3.2) 
63 (3.0) 


Completed 
Post-Secondary 
Education but Not a 
Bachelor's Degree 


78 (3.5) 
0 (0.0) 
0 (0.0) 
9 (2.2) 
4 (1.3) 
4 (1.8) 

38 (5.7) 
1 (0.6) 
0 (0.3) 
6 (2.4) 
8 (2.6) 


No Further than 
Upper-Secondary 


Education 


2 (0.9) 
0 (0.0) 
0 (0.0) 
1 (1.3) 
0 (0.2) 
0 (0.0) 
7 (2.7) 
0 (0.0) 
0 (0.0) 
0 (0.0) 
0 (0.0) 
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Exhibit 8.2: Emphasis on Language and Reading Areas in Teachers' Formal 
Education 


Students Categorized by Teachers' Reports 


Language Pedagogy / Teaching Reading Reading Theory 


hse Average Achievement neces Average Achievement Spice Average Achievement 
Country of Students : of Students : of Students : 


Area Area Area Not Area Area Area Not Area Li) Area Not 
Emphasized Emphasized | Emphasized| Emphasized | Emphasized | Emphasized | Emphasized | Emphasized | Emphasized 


2 
R 
3 
2 
2 
LZ 
Australia 81 (2.8) 547 (3.1) 539 (6.7) 68 (3.2 544 (3.1) 547 (4.8) 38 (3.1) 548 (4.0 544 (3.5) 2 
Austria 72 (3.1) 540 (2.9) 544 (4.3) 57 (3.4) 541 (3.4) 541 (3.2) 44 (3.2) 542 (3.5 541 (3.0) 3 
Azerbaijan 84 (2.4) 470 (5.0) 477 (9.2) 85 (2.8 476 (4.0) 457 (17.5) 69 (3.3) 476 (5.0 473 (7.6) = 
Bahrain 87 (2.4) 445 (2.9) 450 (11.8) 66 (4.2 449 (3.5) 442 (7.2) 32 (3.8) 451 (6.0) 445 (3.5) 5 
Belgium (Flemish) 77 (3.3) 526 (2.4) 523 (3.7) 63 (3.7 525 (2.5) 525 (3.2) 43 (3.8) 529 (3.2 523 (2.7) FE 
Belgium (French) 76 (3.8) 496 (3.0) 505 (6.0) 57 (3.9 501 (3.0) 494 (4.7) 25 (3.3) 498 (5.0 498 (3.0) 7 
Bulgaria 97 (1.1) 550 (4.3) 591 (16.0) 95 (1.7 552 (4.4) 560 (12.6) 39 (3.8) 555 (6.4 551 (63) 
Canada 55 (2.3) 541 (2.3) 547 (2.3) 61 (2.2 543 (2.3) 544 (2.7) 20 (1.8) 543 (3.9 543 (2.1) é 
Chile 60 (4.6) 491 (4.2) 504 (4.8) 57 (4.8 491 (4.4) 504 (5.4) 6 28 (4.3) 490 (6.9 502 (3.6) & 
Chinese Taipei 22 (3.3) 556 (3.8) 560 (2.3) 48 (3.8 560 (2.6) 558 (2.7) 14 (2.8) 555 (5.0 559 (2.2) = 
Czech Republic 89 (2.0) 543 (2.2) 550 (6.0) 69 (3.2 545 (2.3) 540 (3.9) 24 (2.2) 544 (3.9 543 (2.3) re 
Denmark 77 (3.3) 548 (2.4) 545 (4.2) 57 (3.9 547 (2.6) 548 (3.6) 42 (4.0) 548 (3.3 548 (2.9) = 
Egypt 83 (3.6) 339 (6.5) 290 (18.4) 70 (4.1 338 (7.5) 320 (11.2) 44 (4.5) 338 (11.0) 327 (8.2) 
England 74 (3.5) 558 (2.3) 559 (4.1) 65 (3.5 561 (2.8) 554 (4.2) 16 (2.6) 561 (7.7 558 (2.5) 
Finland 23 (2.9) 564 (3.3) 567 (2.1) 21 (2.5 565 (3.0) 567 (2.2) 10 (2.1) 555 (5.1 567 (2.1) 
France 70 (3.6) 512 (2.6) 511 (4.8) 41 3.8 516 (3.9) 508 (2.5) 18 (3.3) 517 (6.7 510 (2.3) 
Georgia 73 (3.6) 491 (3.6) 489 (4.4) 82 (2.9 488 (2.9) 498 (7.4) 58 (3.5) 486 (3.7 497 (4.4) 
Germany 60 (3.6) 542 (3.3) 530 (6.8) 44 (3.7 537 (6.5) 538 (3.7) 24 (3.1) 540 (5.0 537 (4.1) 
Hong Kong SAR 79 (3.0) 571 (3.0) 559 (5.9) 58 (4.4) 572 (3.6) 564 (4.3) 14 (3.4) 568 (10.0) 570 (2.9) 
Hungary 84 (2.8) 555 (3.1) 551 (10.8) 86 (3.0 555 (3.3) 551 (11.2) 26 (3.5) 546 (5.6 557 (3.9) 
Iran, Islamic Rep. of 36 (3.1) 421 (7.8) 432 (5.4) 64 (3.4 424 (5.9) 435 (6.0) 19 (3.2) 411 (9.9 432 (5.0) 
Ireland 69 (4.1) 568 (2.6) 563 (4.9) 76 (3.6 567 (3.2) 565 (5.0) 36 (4.1) 565 (5.4) 567 (2.9) 
Israel 66 (3.8) 519 (4.4) 551 (4.5) 68 (3.9 529 (3.7) 530 (8.2) 42 (4.1) 520 (5.9 538 (5.2) 
Italy 33 (3.8) 554 (2.8) 546 (3.4) 30 (3.6 548 (5.0) 549 (2.7) 13 (2.8) 553 (5.3 548 (2.9) 
Kazakhstan 60 (3.5) 543 (3.9) 528 (3.6) 74 (3.2 539 (3.0) 531 (5.4) 56 (4.6) 540 (3.9 533 (4.1) 
Kuwait 81 (3.1) 396 (4.6) 388 (14.6) 6 64 (5.7 395 (7.0) 399 (12.5) 1 32 (4.5) 383 (11.3) 401 (6.6) 
Latvia 67 (3.6) 557 (2.1) 559 (3.9) 23 (3.6 560 (2.1) 557 (4.1) 33 (3.6) 557 (3.3 559 (2.4) 
Lithuania 64 (3.7) 551 (3.2) 542 (5.1) 80 (3.1) 550 (3.0) 541 (6.9) 56 (4.2) 548 (3.7 548 (4.2) 
Macao SAR 53 (0.1) 554 (1.4) 535 (1.6) 38 (0.1 561 (1.7) 536 (1.2) 9 (0.1) 548 (3.6 545 (1.0) 
Malta 71 (0.1) 453 (1.9) 449 (3.0) 80 (0.1 454 (2.0) 444 (3.4) 28 (0.1) 460 (2.7 449 (2.1) 
Morocco 85 (2.4) 362 (4.4) 339 (13.1) 74 (3.3 353 (5.9) 371 (9.6) © 35 (3.4) 363 (7.7 356 (6.3) 
Netherlands 35 (4.4) 540 (3.9) 547 (2.3) 59 (4.0 543 (2.8) 546 (2.5) 29 (3.4) 545 (5.0 544 (2.0) 
New Zealand 70 (2.9) 525 (2.7) 532 (4.8) 73 (2.6 531 (2.9) 515 (6.3) 39 (3.1) 528 (4.2 525 (4.2) 
Northern Ireland 69 (3.8) 564 (2.9) 564 (4.8) 6 56 (5.0 567 (3.6) 561 (3.7) 4 26 (4.3) 571 (5.9 561 (2.8) 
Norway (5) 57 (3.5) 560 (2.7) 558 (3.2) 47 (4.0 562 (3.4) 556 (2.8) 12 (2.3) 560 (6.2 559 (2.4) 
Oman 86 (2.2) 419 (3.7) 417 (7.8) 75 (3.0 423 (4.1) 406 (5.3) 32 (2.9) 420 (6.7 419 (4.1) 
Poland 94 (1.8) 565 (2.3) 564 (9.5) 50 (4.0 561 (3.2) 569 (3.1) 30 (3.8) 557 (4.4 568 (2.5) 
Portugal 67 (3.4) 527 (2.7) 532 (5.0) 63 (3.6 527 (2.9) 530 (4.9) 29 (3.2) 529 (4.4) 528 (3.1) 
Qatar 90 (1.4) 439 (2.4) 465 (13.8) 75 (2.3 446 (2.7) 435 (7.0) 37 (3.0) 436 (6.5 447 (4.7) 
Russian Federation 75 (3.1) 583 (2.7) 571 (4.9) 85 (2.2 582 (2.5) 574 (6.4) 46 (3.9) 579 (4.3 582 (3.2) 
Saudi Arabia 72 (3.5) 438 (5.1) 420 (9.1) 6 70 (4.1 434 (6.2) 433 (9.2) Ss 32 (4.7) 434 (9.2 433 (7.8) 
Singapore 83 (2.2) 578 (3.4) 567 (8.5) 80 (2.0 580 (3.4) 560 (7.5) 28 (2.4) 591 (5.8 571 (3.8) 
Slovak Republic 93 (1.7) 535 (3.1) 532 (13.3) 76 (2.6 536 (3.1) 532 (8.4) 36 (3.3) 535 (4.5 535 (4.2) 
Slovenia 59 (4.0) 544 (2.3) 540 (3.6) 24 (3.0 543 (2.8) 542 (2.4) 6 (2.1) 544 (5.1 542 (2.1) 
South Africa r 71 (3.7) 328 (6.7) 313 (10.2) s 58 (4.1 320 (7.8) 330 (9.7) Ss 36 (4.1) 313 (6.3 330 (8.7) 
Spain 82 (2.5) 529 (2.0) 526 (4.9) 58 (3.4) 531 (2.0) 523 (3.4) 15 (2.2) 538 (3.3 526 (2.1) 
Sweden 82 (3.0) 555 (2.6) 559 (5.8) 56 (4.1 556 (3.2) 555 (3.5) 46 (4.6) 556 (3.8 555 (3.1) 
Trinidad and Tobago 77 (3.1) 484 (4.3) 464 (6.5) 72 (3.7 478 (4.7) 480 (7.7) 49 (4.3) 477 (5.1 480 (6.6) 
United Arab Emirates 85 (1.8) 450 (3.8) 470 (9.3) 69 (2.5 454 (4.6) 457 (6.9) 43 (2.7) 456 (6.4 454 (5.5) 
United States 45 (3.7) 552 (4.9) 548 (4.1) 76 (3.0 550 (3.5) 548 (7.2) 39 (3.4) 558 (4.1 545 (4.3) 


International Avg. 70 (0.4) 512 (0.5 510 (1.1) a(R) BYP A(IK3) 509 (0.9) By (e)) 511 (0.8) 511 (0.6) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
An “r" indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are available for at least 50% but less than 70% of the students. 
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Benchmarking Participants 


Buenos Aires, Argentina 
Ontario, Canada 
Quebec, Canada 


Moscow City, Russian Fed. 
Eng/Afr/Zulu - RSA (5) 
Andalusia, Spain 


Abu Dhabi, UAE 


Exhibit 8.2: Emphasis on Language and Reading Areas in Teachers' Formal 
Education (Continued) 


Pedagogy / Teaching Reading 


Reading Theory 


Percent 
Average Achievement Average Achievement 
of Students 


Area Area Area Not Area Area Area Not Area Area Area Not 
Emphasized | Emphasized | Emphasized | Emphasized | Emphasized | Emphasized | Emphasized | Emphasized | Emphasized 


Downloaded from http://pirls2016.org/download-center/ 


Language 
Percent , Percent 
43 (4.4) 488 (6.0) 477 (4.9) 61 (4.3) 
51 (4.4) 545 (4.3) 545 (4.4) 63 (4.0) 
74 (4.5) 546 (2.9) 549 (6.2) 68 (4.5) 
78 (3.2) 503 (3.2) 498 (5.4) 66 (3.5) 
45 (3.7) 516 (3.1) 518 (2.5) 46 (3.5) 
69 (3.6) 615 (2.6) 606 (3.7) 85 (3.0) 
77 (4.8) 423 (8.4) 403 (14.8) 61 (6.5) 
84 (2.8) 526 (1.9) 515 (7.3) 59 (4.3) 
81 (3.0) 548 (2.3) 552 (3.8) 66 (3.8) 
87 (2.6) 412 (5.3) 446 (15.3) 69 (4.2) 
85 (1.9) 515 (2.5) 527 (6.0) 64 (2.0) 


481 (4.8) 
545 (4.1) 
545 (3.1) 
503 (3.7) 
515 (2.8) 
614 (2.5) 


406 (11.9) 


527 (2.7) 
548 (2.4) 
415 (6.6) 
520 (2.6) 


482 (6.4) 
542 (4.0) 
550 (5.8) 
497 (4.6) 
519 (2.5) 
605 (4.9) 


440 (14.9) 


521 (3.8) 
551 (3.0) 


423 (11.2) 


515 (4.7) 


31 (4.0) 
19 (3.3) 
18 (4.0) 
52 (4.4) 
13 (2.4) 
39 (3.7) 
40 (6.3) 
17 (2.9) 
24 (3.4) 
36 (4.6) 
37 (3.3) 


482 (5.4) 
539 (6.4) 
543 (7.6) 
504 (4.0) 
510 (7.3) 
615 (3.6) 


387 (11.3) 


534 (3.2) 
550 (5.3) 
412 (9.9) 
520 (4.6) 


483 (4.7) 
544 (3.7) 
547 (3.2) 
498 (3.8) 
518 (2.0) 
610 (2.6) 
440 (11.0) 
522 (2.5) 
549 (2.1) 
420 (7.4) 
515 (3.6) 
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IE A International Study Center 


Lynch School of Education 
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Exhibit 8.3: Teachers’ Years of Experience 
Exhibit 8.3 presents teachers’ reports about their years of experience. On average, fourth grade 
students’ reading teachers had been teaching for 17 years. Forty-two percent of the students had 
very experienced teachers with 20 years or more of experience, and another 30 percent had teachers 
with at least 10 years of experience. 

Some research has found experience can have a large impact on effectiveness, especially during 
the first few years of teaching, and the PIRLS results show this pattern. Fifteen percent of the students 
had teachers with at least 5 years of experience and 13 percent had teachers with less than 5 years of 
experience, with somewhat higher reading achievement associated with teachers having more than 


5 years of experience (510 vs. 505). Of course, there is a variety of policies about whether more or 
less experienced teachers are assigned to higher or lower achieving students. 
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Exhibit 8.3: Teachers’ Years of Experience 


Students Categorized by Teachers' Reports 


20 Years or More 


Country 


Percent of 
Students 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Average 
Achievement 


A tilde (~) indicates insufficient data to report achievement. 


ayn 


At Least 10 but Less 
than 20 Years 


Percent of 
Students 


Achievement 


ugn 


Average 


At Least 5 but Less 
than 10 Years 


Average 


Achievement 


Percent of 
Students 
1 


Less than 5 Years 


Average 


Years of 


Percent of Average 


Experience 


Students Achievement 


Australia (3.3) 547 (4.4) 23 (2.9) 542 (4.2) 5 (2.7) 549 (7.4) 22 (2.8) 542 (7.6) 17 (0.8) 
Austria 59 (3.7) 541 (3.1) 19 (2.9) 551 (5.3) 12 (2.2) 528 (6.8) 10 (2.0) 542 (6.8) 22 (0.9) 
Azerbaijan 64 (3.3) 474 (5.7) 24 (2.9) 471 (9.6) 6 (1.8) 475 (17.7) 6 (1.6) 451 (10.0) 23 (0.7) 
Bahrain 12 (2.5) 429 (9.9) 45 (4.8) 450 (4.8) 18 (3.9) 452 (9.0) 25 (2.6) 438 (7.8) 11 (0.5) 
Belgium (Flemish) 37 (3.5) 529 (3.2) 37 (3.6) 529 (2.8) 10 (1.9) 516 (7.8) 17 (2.7) 514 (5.0) 17 (0.7) 
Belgium (French) 47 (3.8) 503 (3.5) 31 (3.5) 494 (5.2) 15 (2.7) 494 (8.0) 6 (1.6) 479 (8.8) 19 (0.8) 
Bulgaria 87 (2.9) 550 (4.7) 8 (2.3) 549 (13.1) 3 (1.2) 583 (8.8) 2 (0.8) ~~ 28 (0.7) 
Canada 28 (2.1) 545 (3.4) 37 (2.4) 545 (3.0) 20 (1.9) 540 (3.9) 16 (1.7) 540 (6.4) 14 (0.4) 
Chile 28 (4.6) 503 (5.1) 27 (4.4) 498 (6.7) 28 (4.6) 487 (7.8) 17 (3.3) 501 (8.4) 15 (1.1) 
Chinese Taipei 42 (4.0) 556 (2.6) 45 (4.1) 561 (3.0) 8 (2.3) 565 (5.8) 4 (1.6) 549 (9.9) 18 (0.6) 
Czech Republic 54 (3.5) 545 (3.0) 24 (3.0) 545 (3.9) 11 (2.4) 537 (7.9) 11 (2.1) 538 (4.4) 20 (0.7) 
Denmark 31 (3.8) 554 (3.6) 38 (4.3) 543 (3.7) 21 (3.1) 547 (4.3) 10 (2.2) 546 (6.6) 16 (0.8) 
Egypt 43 (4.4) 315 (9.3) 32 (3.9) 353 (9.5) 18 (3.6) 332 (16.9) 7 (1.9) 318 (29.5) 17 (0.9) 
England 20 (3.0) 563 (4.7) zs (3.3) 554 (4.6) 18 (2.8) 563 (4.3) 35 (3.3) 557 (4.1) 11 (0.7) 
Finland 38 (3.1) 567 (3.2) 25 (2.5) 565 (4.9) 18 (2.5) 563 (3.6) 18 (2.8) 571 (3.4) 16 (0.8) 
France 30 (3.6) 521 (3.6) 41 (3.7) 510 (3.3) 18 (2.6) 509 (8.1) 12 (2.2) 495 (7.0) 16 (0.7) 
Georgia 67 (3.5) 488 (3.2) 23 (3.1) 492 (6.4) 7 (1.9) 486 (11.4) 3 (1.2) 518 (16.0) 23 (0.8) 
Germany 38 (3.8) 536 (6.7) 32 (3.7) 544 (4.0) 17 (2.8) 527 (8.7) 13 (2.5) 544 (8.0) (0.9) 
Hong Kong SAR 34 (3.9) 576 (5.0) 40 (4.3) 570 (4.8) 13 (3.0) 563 (8.6) 13 (2.4) 561 (6.6) 15 (0.6) 
Hungary 61 (4.0) 558 (4.1) 22 (3.2) 560 (6.4) 13 (2.5) 535 (11.2) 4 (1.5) 532 (20.2) 24 (1.0) 
Iran, Islamic Rep. of 49 (3.6) 444 (5.6) 23 (3.4) 415 (11.0) 15 (2.2) 404 (14.6) é (2.6) 415 (12.0) (0.7) 
Ireland 20 (3.3) 567 (5.0) 29 (3.4) 569 (4.0) 34 (4.1) 567 (4.8) 7 (2.6) 563 (5.5) 13 (0.9) 
Israel s (3.5) 547 (6.3) 34 (4.0) 520 (8.1) 23 (3.8) 525 (9.6) 9 (2.4) 520 (16.6) 16 (0.8) 
Italy 71 (3.0) 552 (2.7) 22 (2.9) 543 (5.4) 3 (0.8) 530 (12.9) 4 (1.7) 524 (13.8) 25 (0.8) 
Kazakhstan 50 (4.0) 540 (3.5) 30 (3.7) 536 (5.2) 9 (2.2) 535 (8.5) 10 (2.2) 521 (7.5) 20 (0.8) 
Kuwait 14 (3.6) 398 (22.8) AQ (5.5) 400 (8.8) 23 (4.0) 383 (8.0) 23 (4.6) 399 (15.6) 11 (0.7) 
Latvia 81 (2.9) 557 (2.1) 12 (2.3) 565 (5.5) 4 (1.6) 556 (8.7) 3 (1.1) 548 (7.6) 27 (0.7) 
Lithuania 86 (2.4) 548 (2.7) 11 (2.1) 549 (13.0) 2 (1.0) ~~ 1 (0.6) ~~ 27 (0.6) 
Macao SAR 30 (0.1) 547 (1.7) 28 (0.1) 545 (2.4) 18 (0.1) 546 (2.3) 23 (0.1) 542 (2.8) 14 (0.0) 
Malta 19 (0.1) 462 (3.8) 35 (0.2) 464 (2.6) 17 (0.1) 448 (3.8) 30 (0.1) 434 (2.5) 11 (0.0) 
Morocco 56 (2.8) 346 (5.0) 21 (2.8) 364 (8.8) 13 (2.5) 369 (16.9) 10 (2.4) 383 (19.2) 21 (0.6) 
Netherlands 39 (3.9) 548 (2.7) 29 (3.2) 545 (3.6) 15 (3.0) 545 (4.7) 17 (2.9) 540 (7.3) 17 (0.9) 
New Zealand 21 (2.3) 529 (5.9) 40 (2.6) 532 (3.6) 18 (1.9) 521 (6.0) 22 (2.6) 520 (7.7) 13 (0.6) 
Northern Ireland 45 (4.2) 558 (3.3) = (4.2) 570 (5.2) 15 (3.6) 577 (6.0) 11 (2.6) 554 (8.6) 18 (0.9) 
Norway (5) 28 (3.5) 562 (4.0) 37 (4.1) 559 (2.8) 19 (3.3) 559 (4.5) 16 (2.9) 554 (5.2) 15 (0.8) 
Oman 20 (2.9) 434 (8.0) 33 (3.1) 412 (4.4) 30 (3.2) 415 (7.2) 17 422) 417 (5.4) 12 (0.5) 
Poland 56 (3.8) 566 (2.9) 29 (3.3) 564 (4.0) 4 (1.3) 563 (8.8) 10 (2.6) 561 (8.2) 21 (0.9) 
Portugal 46 (2.6) 529 (2.5) 48 (3.3) 527 (4.2) 4 (2.2) 538 (8.4) 2 (0.9) ~~ 21 (0.4) 
Qatar 14 (1.7) 452 (9.8) 27 (2.0) 440 (4.7) 33 (2.2) 440 (6.5) 27 (2.2) 442 (7.0) 10 (0.4) 
Russian Federation 75 (3.3) 583 (2.9) 12 (2.5) 572 (9.1) 7 (1.8) 582 (10.6) 6 (1.7) 570 (10.2) 25 (0.9) 
Saudi Arabia * (4.0) 424 (7.9) 36 (4.0) 420 (7.7) 23 (3.8) 435 (11.0) 8 (2.2) 458 (23.0) 15 (0.6) 
Singapore 19 (2.3) 580 (9.1) 36 (2.9) 578 (5.3) 22 (2.0) 579 (6.4) 22 (2.4) 567 (6.3) 13 (0.5) 
Slovak Republic 56 (3.7) 540 (3.9) 27 (3.1) 527 (6.6) 9 (1.8) 536 (9.8) 8 (1.9) 520 (13.3) 22 (0.8) 
Slovenia 66 (3.7) 543 (2.6) 25 (3.3) 539 (3.3) 6 (1.8) 543 (6.9) 3 (1.2) 562 (7.2) 24 (0.7) 
South Africa r 40 (4.0) 315 (7.8) 24 (3.3) 325 (7.6) 13 (2.5) 313 (17.9) 23 (3.1) 322 (11.4) 15 (0.7) 
Spain 47 (3.2) 527 (2.3) 26 (2.5) 531 (3.2) 18 (2.5) 526 (7.5) 8 (1.6) 525 (4.4) 19 (0.8) 
Sweden 19 (3.2) 554 (4.9) 43 (4.7) 559 (3.1) 17 (3.8) 563 (6.4) 21 (3.5) 544 (4.3) 13 (0.7) 
Trinidad and Tobago 44 (3.9) 478 (5.8) 36 (3.6) 472 (7.5) 9 (2.0) 510 (14.7) 11 (2.9) 482 (14.8) 18 (0.8) 
United Arab Emirates 12 (1.4) 444 (11.7) 34 (2.6) 433 (5.0) 30 (2.2) 465 (7.6) 24 (2.4) 471 (6.5) 10 (0.3) 
United States 30 = 7 557 e 2 37 e ! 549 e : 16 ( ee 553 = “ 17 . “ 535 “ “ 15 (0.8) 
70) 


An “r" indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are available for at least 50% but less than 70% of the students. 
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Exhibit 8.3: Teachers’ Years of Experience (Continued) 


20 Years or More 


Country 
Percent of Average 
Students Achievement 


Benchmarking Participants 


Buenos Aires, Argentina 25 (3.6) 
Ontario, Canada 23 (3.4) 
Quebec, Canada 36 (5.5) 
Denmark (3) 30 (3.7) 
Norway (4) 24 (3.0) 
Moscow City, Russian Fed. 65 (3.6) 
Eng/Afr/Zulu - RSA (5) 5 40 (5.8) 
Andalusia, Spain 48 (4.0) 
Madrid, Spain 38 (4.2) 
Abu Dhabi, UAE 15 (3.0) 
Dubai, UAE 17 (2.9) 


Downloaded from http://pirls2016.org/download-center/ 


495 (6.1) 
547 (6.9) 
550 (5.8) 
509 (5.0) 
515 (4.0) 
615 (2.5) 
427 (10.3) 
527 (2.5) 
547 (3.2) 
386 (15.7) 
505 (10.5) 


At Least 10 but Less 
than 20 Years 


25 (3.3) 
Al (4.6) 
37 (4.7) 
45 (3.9) 
40 (3.4) 
20 (2.9) 
29 (5.6) 
25 (3.5) 
31 (4.1) 
33 (4.1) 
28 (2.7) 


469 (6.6) 
543 (5.4) 
545 (4.4) 
499 (3.7) 
519 (3.3) 
612 (5.4) 
420 (15.6) 
527 (4.4) 
551 (3.8) 
400 (9.3) 
503 (7.2) 


At Least 5 but Less 
than 10 Years 


28 (3.2) 
31 (3.7) 


484 (6.0) 
542 (6.1) 
547 (5.6) 
505 (7.9) 
514 (4.0) 
605 (8.2) 
408 (29.3) 
522 (5.0) 
548 (4.2) 
417 (11.1) 
528 (5.3) 


ZF 
iF 


16 (3.0) 
14 (2.9) 
12 (3.0) 
12 (2.5) 
14 (2.5) 
7 (1.9) 
18 (4.8) 
10 (2.6) 
11 (2.7) 
25 (3.5) 
24 (3.9) 


473 (8.2) 
549 (5.6) 
547 (8.0) 
489 (9.5) 
523 (5.4) 
598 (8.7) 
416 (14.1) 
511 (11.3) 
551 (4.6) 
453 (10.9) 
525 (5.7) 


Average 
Years of 


16 (1.0) 
19 (0.9) 
17 (1.0) 
10 (0.6) 
11 (0.5) 


TIMSS & PIRLS 


IE A International Study Center 


Lynch School of Education 
BOSTON COLLEGE 
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Exhibit 8.4: Teacher Time Spent on Professional Development Related to 
Reading in the Past Two Years 
In general, teachers did not spend very much time on professional development related to reading. 
Exhibit 8.4 shows the results for teachers’ reports about how much time they had spent on 
professional development related to reading in the past two years. Sixteen percent of the fourth 
grade students had teachers who had spent no time and another 22 percent had teachers who had 
spent less than 6 hours (38% in total). Twenty-seven percent of the students had teachers who had 
spent 6 to 15 hours and 36 percent had teachers who had spent 16 hours or more on professional 
development related to reading. Consistent with considerable research showing little impact from 
small amounts of time spent on professional development, students had essentially the same average 
reading achievement for the different amounts of their teachers’ professional development. 
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Exhibit 8.4: Teacher Time Spent on Professional Development Related 
to Reading in the Past Two Years 
Students Categorized by Teachers’ Reports 


Country 


Percent of Average Percent of Average Percent of Average Percent of Average 
Students Achievement Students Achievement Students Achievement Students Achievement 


Tt 
Australia 49 (3.8) 542 (3.8) 27 (3.6) 44 (5.2 2.7) 556 (5.7) 3 (0.9) a (12.8) 3 
Austria 28 (3:2 542 (4.3) 49 (3.4) aa B5 16 (2.4) 547 (5.3) 7 (1.9) 44 (5.2 g 
Azerbaijan 67 (3.7) 477 (4.7) 22 (3.1) 468 (12.9) 6 (1.7) 455 (16.4) 5 (1.4) - (18.9) > 
Bahrain 42 (3.1) 460 (5.2) 27 (3.1) 433 (6.1 20 (2.5) 439 (7.5) HAND 2} 422 (13.8) 3 
Belgium (Flemish) 6 (1.5) 516 (9.7) 20 (3.2) 527 (4.8 39 (3.5) 522 (3.5) 35 (3.6) 530 (3.4 = 
Belgium (French) 8 (1.8 496 (7.3) 24 (3.4) 505 (6.0) 30 (3.3) 491 (4.8) 38 (3.7) 499 (4.2 s 
Bulgaria 33 (3.3 556 (6.3) 35 (3.7) 552 (7.2 18 (3.0) 550 (10.6) 13 (2.7) 540 (11.5) E 
Canada 34 (2.0) 537 (3.3) 30 (2.1) 545 (3.1 29 (2.2) 546 (3.1) 8 (1.3) 556 (4.5 E 
Chile 49 (4.4) 496 (5.2) (3.7) 495 (5.0 15 (3.5) 490 (7.6) 9 (2.8) 518 (9.3 e 
Chinese Taipei 39 (4.1 562 (2.9) 31 (3.9) 559 (4.1 26 (3.6) 554 (2.8) 4 (1.7) 565 (11.6) 5 
Czech Republic 12 (2.4 543 (5.8) 36 (3.3) 542 (3.3 30 (3.3) 546 (3.3) 22 (2.7) 542 (5.7 a 
Denmark 26 (3.2) 549 (5.0) 17 (3,3) 552 (4.7, 14 (2.7) 548 (6.9) 43 (3.6) 545 (2.7 a 
Egypt 52 (4.3) 328 (7.7) 29 (3.6) 328 (13.2) 14 (3.1) 342 (14.8) 5 (1.8) 328 (13.8) u 
England 20 (2.9) 551 (5.8) 29 (3.5) 560 (5.3) 34 (3.4) 556 (3.5) 18 (2.9) 566 (4.5 2 
Finland 5 (1.1) 549 (5.5) 12 (2.2) 563 (5.3 24 (3.0) 562 (4.3) 59 (3.1) 569 (2.1 fi 
France 6 (1.4) 502 (12.0) 18 (3.1) 515 (4.2) 38 (3.8) 509 (4.4) 38 (4.3) 514 (3.1 
Georgia 68 (3.9) 489 (3.5) 19 (2.9) 487 (6.9 6 (2.1) 492 (11.9) 7 (2.0) 490 (11.0) 
Germany 5 (1.8) 563 (9.4) 26 (3.3) 530 (9.4) 41 (3.8) 539 (4.3) 27 (3.4) 539 (5.4 
Hong Kong SAR 22 (3.7) 573 (7.7) 35 (4.0) 562 (4.5 31 (4.1) 572 (4.7) 12 (2.8) ot (9.3 
Hungary 25 (3.4) 551 (6.6) 15 (2.5) 567 (5.8 25 (3.6) 564 (6.9) 36 (3.4) 44 (6.8 
Iran, Islamic Rep. of 58 (3.5) 426 (6.4) 15 (2.5) 417 (11.8) 13 (2.7) 439 (11.4) 14 (2.9) _ (8.6 
Ireland 34 (3.3) 564 (5.9) 22 (3,3) 567 (4.8 35 (3.6) 567 (4.2) 10 (2.2) 572 (6.2 
Israel 54 (3.5) 522 (5.0) 19 (3.4) 528 (10.8) 16 (2.9) 544 (7.5) 11 (2.5) 553 (7.2 
Italy 25 (3.7) 549 (4.1) 26 (3.2) 549 (4.7 23 (3.3) 551 (4.9) 26 (3.4) 546 (5.4) 
Kazakhstan 60 (3.5) 540 (3.6) 25 (3.3) 532 (4.4) 11 (2.4) 526 (8.4) 3 (1.4) 547 (19.0) 
Kuwait 24 (3.2) 388 (12.1) 34 (5.8) 395 (11.5) 29 (4.4) 396 (10.6) 13 (4.0) 395 (18.9) 
Latvia 48 (3.9) 558 (3.2) 33 (4.0) 552 (3.4) 14 (2.7) 570 (4.3) 5 (1.6) 564 (9.8 
Lithuania as) 544 (6.0) 48 (3.5) 550 (3.5) 21 (2.8) 552 (7.6) 5 (1.7) 538 (10.7) 
Macao SAR 62 (0.1) 550 (1.3) 21 (0.1) 545 (2.0 14 (0.1) 532 (2.9) 2 (0.0) id 
Malta 29 (0.1) 442 (3.1) 38 (0.1) 460 (2.2) 29 (0.1) 449 (3.1) 5 (0.1) 463 (5.5 
Morocco 7 (1.7) 393 (21.6) 6 (1.4) 396 (17.3) 21 (2.9) 359 (11.1) 66 (3.0) 350 (5.2 
Netherlands 28 (3.9) 539 (4.1) 30 (4.0) 546 (3.8 33 (4.4) 546 (4.0) 10 (2.0) 560 (4.1 
New Zealand 41 (2.7) 517 (4.0) 30 (2.5) 529 (3.8 22 (2.2) 534 (5.5) 7 (1.4) 547 (8.3 
Northern Ireland 25 (4.4) 566 (5.6) 31 (4.8) 559 (5.1 34 (4.9) 565 (4.2) 10 (2.7) 568 (8.5 
Norway (5) 32 (3.5) 561 (3.6) 32 (3.5) 559 (4.0 18 (3.1) 560 (4.7) 18 (2.7) 553 (4.0 
Oman 52 (3.0) 420 (4.8) 26 (2.6) 425 (5.5 17 (2.6) 411 (6.2) 51,5) 407 (8.8 
Poland 23 (3.7) 561 (5.2) 27 (2.9) 556 (4.6 33 (3.5) 570 (2.9) 17 (3.4) 573 (6.4 
Portugal 33 (2.9) 531 (4.5) 20 (2.4) 529 (4.8 20 (2.8) 529 (5.6) 28 (2.8) 523 (3.3 
Qatar 57 (2.6) 432 (3.2) 27 (2.7) 454 (6.3 12 (1.5) 457 (7.9) 4 (1.0) 476 (20.3) 
Russian Federation 59 (3.3) 582 (3.5) 16 (2.5) 577 (6.1 15 (2.4) 581 (5.7) 10 (1.7) 580 (5.9 
Saudi Arabia 46 (4.0) 432 (6.5) 37 (3.9) 433 (8.2 13 (2.2) 414 (13.9) 4 (1.5) 436 (15.8) 
Singapore 46 (2.8) 584 (5.0) 31 (2.5) 571 (5.6 16 (1.9) 573 (8.7) 72) 562 (10.8) 
Slovak Republic 24 (3.2) 523 (8.7) 15 (2.3) 544 (3.7 24 (3.3) 540 (8.2) 37 (3.1) 535 (5.8 
Slovenia 13 (2.2) 542 (3.7) 39 (3.6) 542 (3.6 32 (3.6) 541 (3.2) 15 (2.9) 544 (5.5 
South Africa r 43 (3.8) 322 (7.6) 25 (3.0) 315 (13.7) 24 (3.3) 323 (9.1) 9 (1.9) 326 (21.2) 
Spain 48 (2.9) 527 (2.1) 21 (2.0) 526 (5.8 15 (2.4) 528 (4.4) 17 1233) 535. (33 
Sweden 37 (3.9) 555 (3.8) 25 (3.6) 556 (5.3 24 (3.8) 557 (4.6) 15 (2.9) 554 (5.7 
Trinidad and Tobago 49 (4.1) 471 (5.8) 26 (3.5) 473 (6.7 16 (3.0) 494 (10.5) 9 (2.6) 519 (17.7) 
United Arab Emirates 50 (2.6) 437 (4.9) 31 (2.6) 457 (7.2 as 3) 484 (8.6) 2 (0.6) ~~ 
United States 55 ie 7 539 id 3) 28 ; 566 a 7 bal 556 a u 2) 8) ~~ 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A tilde (~) indicates insufficient data to report achievement. 
An “r” indicates data are available for at least 70% but less than 85% of the students. 
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Benchmarking Participants 


Buenos Aires, Argentina 
Ontario, Canada 
Quebec, Canada 


Moscow City, Russian Fed. 
Eng/Afr/Zulu - RSA (5) 
Andalusia, Spain 


Abu Dhabi, UAE 
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Average 


Achievement 


477 (6.3) 
538 (5.7) 
548 (5.4) 
501 (6.1) 
521 (3.9) 
612 (2.7) 
397 (8.6) 
521 (3.2) 
546 (3.3) 
407 (6.5) 
501 (4.1) 


Percent of 
Students 


26 (3.6) 
27 (3.7) 
39 (4.6) 
18 (3.2) 
35 (3.8) 
20 (3.5) 
44 (5.0) 
22 (3.0) 
21 (2.9) 
23 (4.1) 
32 (3.6) 


Exhibit 8.4: Teacher Time Spent on Professional Development Related 
to Reading in the Past Two Years (Continued) 


Average 


Achievement 


473 (5.8) 
548 (6.1) 
540 (5.7) 
505 (6.7) 
515 (3.5) 
618 (4.9) 


430 (10.2) 


531 (4.2) 
551 (3.2) 


415 (13.4) 


523 (5.8) 


Average 


Achievement 


490 (7.9) 
544 (5.5) 
555 (4.0) 
509 (7.4) 
519 (4.1) 
608 (6.1) 


410 (20.6) 


521 (5.3) 
558 (5.4) 


470 (17.3) 


532 (6.1) 


Z 
oS] 


_— 


Percent of 
Students 


15 (2.8) 
9 (2.6) 
9 (2.0) 

47 (3.7) 

14 (2.9) 
6 (2.2) 
6 (2.7) 

13 (2.9) 

21 (3.7) 
2 (1.1) 
3 (0.7) 


TIMSS & PIRLS 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 8.5: Principals’ Formal Education 
Exhibit 8.5 presents principals’ reports about their formal education. On average, about half the 
students (48%) had principals with a postgraduate university degree, 45 percent had principals 
with a bachelor’s degree, and 7 percent had principals who had not completed a bachelor’s degree. 
In 41 of the 50 PIRLS 2016 countries, principals are required to have teaching experience and in 28 
countries they must complete a leadership training program. 
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Exhibit 8.5: Principals’ Formal Education* 


Students Categorized by Principals' Reports; Current Requirements Reported by National Research Coordinators 


Percent of Students by Principal Education Level 


Completed Bachelor's Completion of 
Completed Postgraduate Degree or Equivalent Did Not Complete Teaching Specialized School 
University Degree** but Nota Bachelor's Degree Experience Leadership Training 
Postgraduate Degree Program 


Country 


= 
3 
Australia 41 (3.3) 59 (3.3) 1 (0.4) e O 2 
Austria 9 (2.1) 6 (2.0) 85 (2.9) e 6 & 
Azerbaijan 46 (3.8) 54 (3.8) 0 (0.0) e e 3 
Bahrain 54 (2.9) 44 (2.9) 2 (0.9) e e 2 
Belgium (Flemish) 4 (1.7) 95 (1.9) 1 (0.9) e O 5 
Belgium (French) 6 (2.1) 94 (2.1) 0 (0.0) e ® = 
Bulgaria 95 (1.3) 5 (1.3) 0 (0.0) e © $ 
Canada 64 (2.3) 35 (23) 0 (0.3) e  ) s 
Chile 69 (4.4) 31 (4.4) 0 (0.0) e e 2 
Chinese Taipei 95 (1.6) 5 (1.6) 0 (0.0) e 6 = 
Czech Republic 99 (0.8) 1 (0.8) 0 (0.0) e e g 
Denmark 18 (2.8) 23 (3.5) 9 (2.3) O O 3 
Egypt 3 (14) 58 (4.0) 39 (4.0) e e 
England 28 (3.8) 69 (3.9) 3 (1.4) ie © 
Finland 89 (2.3) 10 (2.2) 1 (0.5) e e 
France 25 (3.5) 49 (4.0) 26 (3.8) e @) 
Georgia 96 (1.4) 3 (1.2) 1 (1.0) e) O 
Germany 90 (1.3) 1 (0.8) 9 (1.6) e Oo 
Hong Kong SAR 62 (3.3) 37 (3.2) 1 (0.9) e@ e 
Hungary 37 (3.7) 61 (3.7) 3 (13) e @ 
Iran, Islamic Rep. of 14 (2.4) 78 (2.7) 8 (1.7) e) O 
Ireland 42 (4.5) 58 (4.5) 1 (0.6) e © 
Israel 91 (2.4) 9 (2.4) 0 (0.0) e e 
Italy 37 (4.3) 59 (4.5) 4 (1.0) e @) 
Kazakhstan 11 (2.5) 83 (3.0) 6 (1.8) e © 
Kuwait 11 (2.2) 77 (3.6) 12 (2.9) e c 
Latvia 92 (2.0) 8 (2.0) 0 (0.0) e Oo 
Lithuania 61 (4.0) 39 (4.0) 0 (0.0) e a 
Macao SAR 62 (0.1) 36 (0.1) 2 (0.0) e) e 
Malta 58 (0.2) 40 (0.2) 2 (0.0) e t 
Morocco 3 (1.0) 63 (3.6) 34 (3.8) e O 
Netherlands 7 (2.5) 9) 025) 0 (0.5) oO tC 
New Zealand 30 (3.0) 55 (3.6) 14 (2.7) e O 
Northern Ireland r 80 (3.7) 19 (4.1) 1 (0.8) e @ 
Norway (5) 45 (4.5) 52 (4.4) 3 (1.5) Oo Oo 
Oman 221) 62 (2.7) 16 (2.5) e * 
Poland 99 (0.7) 1 (0.7) 0 (0.0) - - 
Portugal 37 (4.1) 62 (4.1) 1 (0.4) e e 
Qatar 43 (0.4) 54 (0.4) 3 (0.1) e e 
Russian Federation 90 (2.2) 10 (2.2) 0 (0.0) e 6 
Saudi Arabia 8 (2.0) 73 (3.7) 18 (3.3) e 6) 
Singapore 61 (0.0) 37 (0.0) 1 (0.0) e @ 
Slovak Republic 100 (0.0) 0 (0.0) 0 (0.0) e e 
Slovenia 13 (3.3) 82 (3.7) 5 (1.6) e e 
South Africa r 8 (2.3) 74 (3.7) 18 (3.2) e Oo 
Spain 41 (2.6) 59 (2.6) 0 (0.1) e e 
Sweden 29 (4.1) 66 (4.1) 4 (1.7) e) e 
Trinidad and Tobago 37 (4.2) 58 (4.3) 5 (1.9) e e 
United Arab Emirates 59 (2.2) 33 (2.4) 8 (1.2) ® e 
United States 98 (1.2) 2 (1.2) 0 (0.0) @ e 
. Based on countries’ categorizations according to UNESCO's International Standard Classification of Education @ Yes 
(Operational Manual for ISCED-2011). O No 


** For example, doctorate, master’s, or other postgraduate degree. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A dash (-) indicates comparable data not available. 
An “r" indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are available for at least 50% but less than 70% of the students. 
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Benchmarking Participants 


Buenos Aires, Argentina 
Ontario, Canada 
Quebec, Canada 


Moscow City, Russian Fed. 
Eng/Afr/Zulu - RSA (5) 
Andalusia, Spain 


Abu Dhabi, UAE 
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Completed Postgraduate 
University Degree** 


17 (3.1) 
50 (4.0) 
66 (5.4) 
18 (3.0) 
45 (4.5) 
95 (1.8) 

9 (3.6) 
30 (4.4) 
54 (3.8) 
56 (3.9) 
73 (0.2) 


Exhibit 8.5: Principals’ Formal Education* (Continued) 


Percent of Students by Principal Education Level 


Completed Bachelor's 
Degree or Equivalent 

but Nota 
Postgraduate Degree 


23 (3.5) 
50 (4.0) 
33 (5.2) 
74 (3.8) 
52 (4.5) 

5 (1.8) 
67 (5.7) 
70 (4.4) 
46 (3.7) 
36 (4.1) 
23 (0.2) 


Specialized School 
Leadership Training 


@ec@ecoce@eocceee 
SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 8.6: Principals’ Years of Experience 

Exhibit 8.6 presents principals’ reports about their years of experience. Fourth grade students’ 
principals had 10 years of experience as principals on average. Fourteen percent of the students 
had very experienced principals with 20 years or more of experience, 31 percent had principals with 
at least 10 years of experience, 27 percent had principals with at least 5 years of experience, and 28 
percent had principals with less than 5 years of experience. 
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Country 


ayn 


Students Categorized by Principals' Reports 


Percent of Students by Principals’ Years of Experience as a Principal 


20 Years or More 
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Exhibit 8.6: Principals’ Years of Experience 


At Least 10 but Less 
than 20 Years 


Australia 15 (2.9) 32 (3.8) 
Austria 6 (1.8) 37 (4.4) 
Azerbaijan 32 (3.6) 29 (3.3) 
Bahrain 8 (1.1) 12 (2.0) 
Belgium (Flemish) 8 (2.5) 39 (4.0) 
Belgium (French) 5 (1.8) 34 (3.9) 
Bulgaria 27 (3.6) 35 (4.1) 
Canada 5 (0.9) 33 (2.5) 
Chile 15 (3.4) 23 (3.4) 
Chinese Taipei 4 (1.6) 36 (3.8) 
Czech Republic 19 (3.1) 38 (3.5) 
Denmark 10 (2.5) 37 (3.5) 
Egypt 2 (0.4) 11 (2.9) 
England 8 (2.3) 30 (3.6) 
Finland 20 (3.6) 33 (4.0) 
France 15 (3.3) 35 (4.3) 
Georgia 11 (2.1) 28 (3.6) 
Germany 12 (2.4) 29 (3.8) 
Hong Kong SAR 10 (2.7) 42 (4.3) 
Hungary 12 (3.1) 30 (4.1) 
Iran, Islamic Rep. of 18 (2.9) 38 (3.6) 
lreland 13 (2.9) 30 (3.9) 
Israel 10 (2.1) 26 (3.9) 
Italy 13 (3.2) 21 (3.7) 
Kazakhstan 11 (2.7) 21 (2.7) 
Kuwait 8 (2.1) 19 (4.7) 
Latvia 38 (4.0) 31 (3.6) 
Lithuania 41 (3.7) 34 (3.6) 
Macao SAR 28 (0.1) 24 (0.1) 
Malta 9 (0.1) 21 (0.1) 
Morocco 3 (1.0) 57 (3.2) 
Netherlands r 21 (3.4) 39 (4.9) 
New Zealand 26 (3.0) 32 (3.7) 
Northern Ireland r 27 (4.5) 40 (4.5) 
Norway (5) 12 (2.7) 23 (3.7) 
Oman 12 (2.1) 46 (2.8) 
Poland 21 (3.7) 36 (3.5) 
Portugal 14 (3.0) 32 (4.5) 
Qatar 5 (0.1) 31 (0.4) 
Russian Federation 15 (2.4) 32 (3.3) 
Saudi Arabia 12 (2.3) 35 (3.2) 
Singapore 1 (0.0) 41 (0.0) 
Slovak Republic 8 (2.2) 41 (3.6) 
Slovenia 9 (2.7) 44 (4.3) 
South Africa r 21 (3.4) 32 (4.1) 
Spain 9 (1.6) 26 (2.5) 
Sweden 10 (3.2) 28 (4.0) 
Trinidad and Tobago r PDE 12 (2.4) 
United Arab Emirates 15 (1.8) 35 (2.4) 
United States 1125) 22 (3.8) 


An “r" indicates data are available for at least 70% but less than 85% of the students. 


At Least 5 but Less 
than 10 Years 


25 (2.9) 
38 (4.2) 
20 (3.5) 
36 (2.6) 
34 (4.4) 
34 (4.5) 
21 (3.7) 
32 (2.7) 
31 (5.3) 
36 (4.0) 
22 (3.4) 
24 (3.1) 
28 (3.7) 
25 (3.5) 
24 (3.8) 
30 (4.5) 
29 (3.5) 
24 (3.0) 
27 (4.4) 
35 (3.5) 
23 (2.5) 
31 (3.8) 
31 (3.9) 
25 (3.7) 
27 (3.2) 
37 (5.4) 
14 (3.0) 
10 (2.3) 
26 (0.1) 
36 (0.1) 
25 (2.6) 
24 (4.7) 
21 (3.3) 
19 (4.2) 
26 (3.9) 
21 (2.7) 
22 (3.5) 
27 (4.1) 
39 (0.3) 
26 (2.9) 
20 (2.8) 
30 (0.0) 
27 (3.4) 
29 (4.3) 
21 (3.0) 
29 (2.9) 
32 (4.4) 
40 (4.5) 
24 (2.3) 
22 (3.6) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Less than 5 Years 


27 (3.1) 
20 (3.8) 
19 (3.2) 
44 (2.9) 
19 (2.7) 
27 (4.0) 
17 3.4) 
30 (2.3) 
31 (47) 
24 (3.8) 
22 (3.4) 
30 (3.6) 
59 (4.3) 
36 (3.8) 
23 (3.2) 
21 (3.6) 
32 (3.4) 
35 (3.5) 
22 (3.3) 
2B (3.8) 
21 (3.6) 
25 (3.3) 
33 (3.4) 
41 (4.0) 
41 (3.5) 
36 (3.5) 
17 (3.2) 
15 (2.7) 
21 (0.1) 
34 (0.1) 
16 (2.3) 
17 (3.4) 
21 (3.0) 
15 (3.3) 
40 (4.6) 
20 (2.5) 
20 (3.9) 
26 (3.8) 
24 (0.3) 
26 (3.5) 
33 (3.8) 
28 (0.0) 
24 (3.8) 
17 (3.0) 
26 (3.6) 
36 (2.9) 
30 (3.6) 
46 (4.2) 
25 (2.0) 
44 (4.5) 


Average 
Years of 


Experience as a 
Principal 


10 (0.5) 
14 (0.8) 
7 (0.4) 
10 (0.5) 
9 (0.5) 
13 (0.8) 
8 (0.3) 
10 (0.9) 
9 (0.5) 
12 (0.6) 
10 (0.5) 
5 (0.3) 
9 (0.6) 
12 (0.7) 
11 (0.7) 
9 (0.6) 
9 (0.6) 
10 (0.6) 
10 (0.6) 
12 (0.6) 
10 (0.7) 
9 (0.6) 
9 (0.8) 
9 (0.6) 
8 (0.6) 
16 (0.8) 
16 (0.7) 
14 (0.0) 
9 (0.0) 
11 (0.3) 
13 (0.8) 
13 (0.7) 
14 (0.8) 
9 (0.7) 
12 (0.5) 
13 (0.7) 
10 (0.6) 
9 (0.0) 
11 (0.6) 
10 (0.6) 
9 (0.0) 
10 (0.5) 
11 (0.5) 
12 (0.7) 
9 (0.5) 
9 (0.9) 
6 (0.4) 
11 (0.5) 
8 (0.6) 
10 (0.1) 


ZF 
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Exhibit 8.6: Principals’ Years of Experience (Continued) 


Percent of Students by Principals’ Years of Experience as a Principal 


Countr 
iu 20 Years or More 


Benchmarking Participants 


Buenos Aires, Argentina 9 (2.7) 
Ontario, Canada 2 (1.7) 
Quebec, Canada 5 (2.3) 
Denmark (3) 10 (2.5) 
Norway (4) 12 (2.5) 
Moscow City, Russian Fed. 22 (3.3) 
Eng/Afr/Zulu - RSA (5) r 18 (4.3) 
Andalusia, Spain 5 (2.0) 
Madrid, Spain 10 (2.4) 
Abu Dhabi, UAE 16 (2.7) 
Dubai, UAE 11 (0.1) 


Downloaded from http://pirls2016.org/download-center/ 


At Least 10 but Less 


than 20 Years 


13 (2.6) 
33 (4.5) 
47 (4.6) 
37 (3.6) 
24 (4.0) 
30 (3.9) 
33 (4.9) 
30 (4.3) 
29 (4.0) 
37 (4.1) 
37 (0.2) 


At Least 5 but Less 
than 10 Years 


42 (4.0) 
32 (4.4) 
27 (4.3) 
24 (3.4) 
26 (3.9) 
21 (3.4) 
18 (5.1) 
33 (4.0) 
29 (3.5) 
25 (3.2) 
21 (0.3) 


Less than 5 Years 


36 (4.0) 
32 (4.3) 
21 (4.3) 
29 (3.7) 
39 (4.5) 
26 (3.9) 
31 (5.3) 
33 (4.0) 
32 (4.1) 
22 (3.6) 
32 (0.2) 


Average 
Years of 


Experience 
Principa 


8 (0.7) 
8 (0.5) 
10 (0.7) 
10 (0.6) 
9 (0.7) 
12 (0.8) 
11 (0.9) 
8 (0.6) 
9 (0.7) 
11 (0.5) 
10 (0.0) 


ZF 
iF 


asa 
I 
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GHARIERD;: 
SLASSROOM 
INST RUGHON 


PIRLS ZU1T0O INI ERNATIONAL RESULIS 
IN REAVING 


BOSTON COLLEGE 


READING-FOURTH GRADE PRLS 


Instructional Time 


On average, the fourth grade students in PIRLS 2016 received 898 hours per year 
of instruction across all subjects, with 27% of that time devoted to language 
instruction, including reading, writing, speaking, literature, and other language 
skills. Reading instruction, including reading across the curriculum, on average 
was allotted 18% of total instructional time. 


125 150 175 200 225 250 275 


| | | | | 


| 
156 hours 242 hours 
READING LANGUAGE 
of instructional of instructional 
time on average 


time on average 


Classroom Instruction Percent of 
Limited by students \m 
Student Attributes | 550 
Very 
Little 
€ 
ov 
5 
Extent to which teachers 3 
reported instruction F500 z 
being limited by students’ some ® 
attributes (e.g., lacking s 
prerequisite skills, absent, 2 
suffering from lack of 
nutrition or sleep, |— 450 
disruptive) ALot 


Student Attendance Percent of 
students 


Never or 
Almost 


Frequency of student Never 
absences, as reported 
by students themselves 
Oncea 
Month 
Once Every 
Two Weeks 


Once a Week 
or More 


Average Achievement 


Students Feel Hungry Percent of 
students 


Arrived Le 
at School: 590 
NEVER Feeling 
Hungry 2 
ov 
5 

1in 4 students Zz 
arrived at school SOMETIMES | 500 5 
feeling hungry every Feeling & 
day, and had an Hungry £ 
average achievement 2 
32 points lowerthan Every DAY < 
students who Feeling | 450 

Hungry : 
never felt hungry 
Computer Activities During Reading Lessons 
Teachers reported considerable Average achievement for 
variation in computer students with computer 
availability for availability compared 
use in lessons. to those without 

availability: 
6-8% 
New South Africa, vs 
Zealand, —_ Belgium (Fr), 
Denmark Morocco 


On average across 
countries, students 
were asked to engage 
in various 
computer-based 
activities on at 
least a weekly 
basis 


- 2 TIMSS & PIRLS 
SOURCE: IEA's Progress in International Reading g [EA international Study Center 
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CHAPTER 9 


Classroom Instruction 


Exhibit 9.1: Instruction Time Spent on Language and Reading 


A wide variety of factors influence the relationship between amount of instructional time and 
student achievement, primarily the quality of the instruction and the students’ readiness to learn. 
Nevertheless, instructional time remains a crucial component in considering students’ opportunity 
to learn. 

Exhibit 9.1 presents principals’ and teachers’ reports about the instructional hours per year 
spent on language and reading instruction. The principals provided the number of school days per 
year and the number of instructional hours per day, and the teachers provided the weekly number 
of hours of language and reading instruction. The results for the time spent were based on a series 
of calculations as explained on the second page of the exhibit. On average, the fourth grade students 
in PIRLS 2016 received 898 hours per year of instruction across all subjects. On average, 27 percent 
of that instructional time was devoted to language instruction, including reading, writing, speaking, 
literature, and other language skills, which averaged to 242 hours of instruction per year, while 18 
percent of the total instructional time was devoted to reading, including reading instruction across 
the curriculum, which averaged to 156 hours per year. As might be anticipated, these estimates vary 
somewhat from the levels of instructional time set as a matter of policy. 
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Country 


South Africa 
Chile 
Netherlands 

Israel 

Italy 

United States 
Qatar 

Singapore 
Morocco 

Saudi Arabia 
United Arab Emirates 
Trinidad and Tobago 
Denmark 

Australia 

England 

Oman 

Hong Kong SAR 
Northern Ireland 
Belgium (Flemish) 
Canada 

Malta 

Belgium (French) 
Bahrain 

Macao SAR 

New Zealand 
Egypt 

Ireland 

Portugal 

France 

Kuwait 

Spain 

Chinese Taipei 
Germany 
Kazakhstan 
Norway (5) 
Hungary 

Sweden 

Slovak Republic 
Czech Republic 
Austria 

Azerbaijan 

Poland 

Slovenia 

Finland 

Georgia 

Bulgaria 

Latvia 

Russian Federation 
Lithuania 

Iran, Islamic Rep. of 


Ss 


r 


r 


r 


r 
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Total Instruction Hours 


Exhibit 9.1: Instruction Time Spent on Language and Reading 


Students Categorized by Principals' and Teachers' Reports 


r 
r 
r 


r 
r 
r 
r 


if 


r 


r 


r 


r 


Language Instruction, Including Reading, 
Writing, Speaking, Literature, and Other 


r 
Ss 


r 
r 
r 


= -- 


r 


[r 


Ss 


Ss 


r 


r 


r 
I 


r 
s 


r 


r 


Hours per Year 


Reading Instruction, Including Reading 


Across the Curriculum 


Percent of Total 


122 (8.0) 10 (0.6) 
252 (22.3) 22 (1.9) 
205 (19.5) 19 (1.8) 
98 (8.7) 9 (0.8) 
148 (9.2) 14 (0.9) 
327 (15.6) 32 (1.5) 
182 (14.9) 18 (1.2) 
124 (7.0) 12 (0.7) 
109 (7.8) 11 (0.9) 
175 (13.6) 16 (1.2) 
139 (6.3) 13 (0.7) 
299 (26.4) 30 (2.6) 
132 (7.8) 13 (0.8) 
199 (9.9) 19 (1.0) 
125 (11.3) 12 (1.1) 
150 (7.5) 16 (0.9) 
128 (7.1) 13 (0.8) 
137 (7.8) 14 (0.8) 
84 (5.1) 9 (0.6) 
206 (7.0) 22 (0.8) 
83 (0.4) 9 (0.0) 
247 (16.6) 27 (1.9) 
114 (6.0) 12 (0.6) 
100 (0.2) 10 (0.0) 
215 (8.9) 24 (1.0) 
161 (11.6) 18 (1.3) 
150 (7.2) 16 (0.8) 
301 (10.4) 34 (1.2) 
165 (11.6) 19 (1.2) 
139 (13.8) 17 (1.5) 
136 (6.7) 16 (0.8) 
123 (8.0) 15 (1.0) 
87 (7.3) 11 (1.0) 
212 (11.0) 26 (1.3) 
134 (7.5) 17 (1.0) 
201 (9.3) 25 (1.4) 
101 (8.0) 12 (1.0) 
180 (9.5) 23 (1.2) 
143 (8.9) 19 (1.1) 
95 (5.5) 13 (0.8) 
141 (6.8) 19 (1.1) 
33 (1.7) 4 (0.2) 
84 (5.7) 12 (0.8) 
122 (6.3) 17 (0.9) 
132 (9.5) 19 (1.3) 
247 (14.5) 39 (2.5) 
184 (10.3) 28 (1.6) 
171 (7.0) 27 (1.1) 
144 (8.7) 23 (1.4) 
124 (13.8) 20 (2.2) 


An “r" indicates data are available for at least 70% but less than 85% of the students. An “s” indicates data are available for at least 50% but less 
than 70% of the students. An “x” indicates data are available for less than 50% of students—interpret with caution. 


ZF 
iF 


Instruction Time 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


International Avg. 898 (1.6) 242 (1.4) vy a (\)) 156 (1.5) (0d) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Total Instruction Hours 


Country 


per Year 


All Subjects 


Benchmarking Participants 


Eng/Afr/Zulu - RSA (5) s 
Dubai, UAE r 
Abu Dhabi, UAE r 
Buenos Aires, Argentina 
Ontario, Canada 

Denmark (3) 

Quebec, Canada 

Madrid, Spain 

Andalusia, Spain 

Norway (4) 

Moscow City, Russian Fed. 


= 


Total Instruction 
Hours per Year 


Language Instruction 
Hours per Year 


Reading Instruction 
Hours per Year 


1195 (17.5) 
1013 (0.9) 
1012 (8.5) 


994 (26.4) 
973 (9.9) 
915 (12.9) 
906 (6.1) 
878 (7.5) 
844 (9.0) 
825 (11.2) 
621 (3.8) 
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re) 


Language Instruction, Including Reading, 
Writing, Speaking, Literature, and Other 


Language Skills 


Hours per Year 


223 (8.7) 
220 (8.7) 
( 


280 (20.3) 
228 (10.6) 


290 (8.2) 
278 (4.0) 
305 (8.5) 
203 (6.8) 
229 (6.3) 
233 (8.7) 
260 (5.3) 


Principal Reports of 
School Days per Year 


Teacher Reports of 
Weekly Language 
Instruction Hours, 
Including Reading, 
Writing, Speaking, 
Literature, and Other 
Language Skills 


Principal Reports of 
School Days per Week 


Teacher Reports of 
Weekly Reading 
Instruction Hours, 
Including Reading 
Across the Curriculum 


Principal Reports of 
School Days per Week 


Percent of Total 


Exhibit 9.1: Instruction Time Spent on Language and Reading (Continued) 


Reading Instruction, Including Reading 


Across the Curriculum 


Hours per Year 


Instruction Time 


18 (0.8) 
22 (1.0) 
27 (2.2) 
24 (1.2) 
31 (1.0) 
31 (0.5) 
34 (1.1) 
23 (0.8) 
28 (0.8) 
29 (1.2) 
42 (0.9) 


a a A A 


Principal Reports of 


97 (7.0) 
135 (7.4) 
156 (11.5 
188 (19.9 
234 (12.5 
158 (11.2 
145 (7.7) 
141 (12.1) 
170 (11.6) 
176 (10.9) 
178 (7.0) 


) 
) 
) 
) 


Instruction Hours per Day 


Principal Reports of 
School Days per Year 


Principal Reports of 
School Days per Year 


Percent of Total 
Instruction Time 


8 (0.7) 
12 (0.8) 
15 (1.2) 
19 (1.9) 
24 (1.7) 
17 (1.2) 
16 (0.9) 
17 (1.5) 
21 (1.5) 
22 (1.5) 
29 (1.1) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


TIMSS & PIRLS 
IE A International Study Center 


Lynch School of Education 
BOSTON COLLEGE 
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2016 Gp crade 
Exhibit 9.2: Teachers Develop Students’ Reading Comprehension Skills 
and Strategies 
Exhibit 9.2 presents teachers’ reports about the reading skills and strategies that they include in 
their reading instruction on at least a weekly basis. Most of the students (94-96%) have lessons at 
least weekly on how to locate information within texts, identify main ideas, and explain or support 
their understanding of what they read. Somewhat smaller percentages (75-83%) have at least 
weekly lessons that cover: 1) comparing what they have read to their own experiences, 2) making 
comparisons across texts, 3) making predictions about the texts, or 4) making generalizations 
or inferences. About two-thirds (66-69%) have at least weekly lessons on describing text style or 
structure, or on determining the author's perspective. 
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Exhibit 9.2: Teachers Develop Students’ Reading Comprehension Skills 
and Strategies 


Students Categorized by Teachers' Reports 


Percent of Students Whose Teachers Ask Them to Do the Following At Least Weekly 


Country 


Australia 
Austria 
Azerbaijan 
Bahrain 

Belgium (Flemish) 
Belgium (French) 
Bulgaria 

Canada 

Chile 

Chinese Taipei 
Czech Republic 
Denmark 

Egypt 

England 

Finland 

France 

Georgia 
Germany 

Hong Kong SAR 
Hungary 

Iran, Islamic Rep. of 
Ireland 

Israel 

Italy 

Kazakhstan 
Kuwait 

Latvia 

Lithuania 

Macao SAR 

Malta 

Morocco 
Netherlands 

New Zealand 
Northern Ireland 
Norway (5) 

Oman 

Poland 

Portugal 

Qatar 

Russian Federation 
Saudi Arabia 
Singapore 

Slovak Republic 
Slovenia 

South Africa 
Spain 

Sweden 


Trinidad and Tobago 
United Arab Emirates 


United States 


Locate 
Information 
Within 
the Text 


98 (0.7) 
93 (1.3) 
94 (1.7) 
96 (1.3) 
87 (2.6) 
92 (1.8) 
100 (0.0) 
96 (0.8) 
99 (1.2) 
91 (2.3) 
99 (0.5) 
90 (2.1) 
96 (1.7) 
98 (1.3) 
85 (2.6) 
99 (0.7) 
99 (0.6) 
96 (1.7) 
97 (1.4) 
99 (1.0) 
91 (2.0) 
98 (0.9) 
99 (0.8) 
100 (0.0) 
100 (0.2) 
95 (1.9) 
100 (0.0) 
98 (1.2) 
89 (0.1) 
96 (0.1) 
99 (0.3) 
96 (1.6) 
98 (0.6) 
99 (0.7) 
98 (1.0) 
97 (1.0) 
100 (0.0) 
100 (0.0) 
99 (0.7) 
100 (0.0) 
91 (2.0) 
93 (1.4) 
99 (0.4) 
94 (1.8) 
r 93 (1.8) 
97 (1.0) 
89 (2.2) 
99 (0.7) 
97 (1.2) 
100 “ : 


Identify the 
Main Ideas 
of What 
They Have 
Read 


96 (1.3) 
91 (1.9) 
98 (0.9) 
96 (1.1) 
76 (3.3) 
86 (3.1) 
100 (0.0) 
91 (1.3) 
99 (1.0) 
87 (2.5) 
97 (1.0 
92 (1.6 
98 (1.2 
99 (1.0 
86 (2.2) 
89 (2.2) 
100 (0.4) 
89 (2.0) 
94 (2.4) 
97 (1.5) 
93 (1.7) 
99 (0.8) 
99 (0.9) 
99 (1.0) 
100 (0.0 
90 (4.1 
100 (0.4 
99 (0.5 
90 (0.1) 
97 (0.1) 
97 (0.9) 
78 (3.3) 
96 (1.1) 
96 (2.1) 
89 (2.6) 
99 (0.8) 
100 (0.3) 
99 (0.9) 
99 (0.6) 
100 (0.0) 
92 (2.0) 
89 (1.4) 
98 (0.8) 
90 (2.1) 
96 (1.4) 
96 (1.5) 
79 (3.3) 
95 (2.0) 
98 (0.5) 
98 “ : 


) 
) 
) 
) 


) 
) 
) 
) 


Explain or 
Support Their 
Understanding 
of What They 
Have Read 


98 (0.8) 
87 (2.7) 
98 (1.0) 
97 (1.2) 
90 (2.1) 
87 (2.7) 
100 (0.0) 
92 (1.2) 
100 (0.0) 
82 (3.0) 
99 (0.8) 
88 (2.5) 
97 (1.3) 
99 (0.2) 
79 (3.2) 
91 (1.8) 
100 (0.4) 
95 (1.3) 
91 (2.3) 
100 (0.0) 
88 (2.4) 
97 (1.3) 
99 (0.9) 
98 (1.1) 
100 (0.0) 
98 (1.2) 
97 (1.3) 
100 (0.0) 
85 (0.1) 
96 (0.1) 
96 (1.1) 
87 (2.8) 
95 (1.2) 
98 (1.1) 
87 (2.4) 
100 (0.2) 
99 (0.5) 
99 (0.9) 
99 (0.6) 
100 (0.0) 
94 (1.9) 
91 (1.4) 
99 (0.7) 
93 (1.9) 
r 95 (1.6) 


Compare Compare Make 
What They What They Predictions ERG 
Have Read Have Read About What | Generalizations 
with with Other Will Happen and Draw 
Experiences | Things They Next Inferences 
They Have Had} Have Read in the Text 


89 (1.7) 87 (2.0) 94 (1.5) 93 (1.4) 
66 (3.3) 48 (3.5) 38 (3.1) 50 (3.3) 
95 (1.5) 95 (1.6) 92 (1.8) 90 (1.8) 
88 (1.7) 85 (2.5) 83 (2.1) 78 (2.4) 
65 (3.5) 45 (3.9) 61 (3.5) 59 (3.7) 
42 (4.0) 35 (3.7) 53 (3.7) 56 (4.0) 
95 (1.8) 90 (2.5) 84 (2.7) 99 (0.8) 


82 (1.9) 72 (1.9) 88 (1.5) 86 (1.6) 
99 (1.2) 98 (1.0) 97 (1.5) 94 (2.2) 
76 (3.5) 63 (4.1) 52 (4.0) 67 (3.9) 
83 (2.7) 55 (3.0) 59 (3.1) 72 (2.8) 
68 (3.6) 66 (3.5) 61 (3.8) 64 (4.2) 
86 (3.1) 72 (3.8) 87 (3.0) 79 (3.5) 
76 (3.3) 72 (3.6) 94 (2.3) 94 (2.2) 
72 (3.0) 45 (3.2) 44 (3.7) 51 (3.3) 
41 (4.0) 50 (4.4) 59 (3.4) 64 (3.0) 
98 (1.0) 97 (1.2) 96 (1.5) 99 (0.4) 
69 (3.1) 45 (3.8) 52 (3.7) 63 (3.6) 
78 (3.6) 66 (4.1) 75 (3.7) 80 (2.8) 
95 (1.4) 91 (2.5) 86 (2.5) 94 (1.9) 
79 (2.8) 74 (3.2) 71 (3.3) 82 (2.7) 
90 (2.1) 82 (2.5) 96 (1.7) 88 (2.3) 
91 (2.4) 89 (2.2) 89 (2.8) 95 (1.8) 
91 (2.2) 82 (2.9) 84 (2.5) 78 (2.9) 
a (1.3) 99 (0.8 93 (1.9) 100 (0.1) 

95 (2.0) 85 (2.9 74 (5.0) 79 (3.6) 
92 (2.1) 72 (3.6 79 (2.9) 94 (1.8) 
94 (1.9) 96 (1.5 86 (2.2) 97 (1.2) 
68 (0.1) 52 (0.1) 68 (0.1) 74 (0.1) 


89 (0.1) 78 (0.1) 87 (0.1) 75 (0.1) 
77 (3.0) 72 (2.8) 62 (2.8) 79 (2.7) 
64 (3.6) 45 (4.1) 78 (3.4) 73 (3.5) 
87 (2.0) 76 (2.6) 94 (1.1) 90 (2.1) 
78 (3.7) 78 (3.3) 93 (2.2) 86 (3.2) 
72 (3.2) 61 (3.3) 42 (3.7) 54 (3.8) 
95 (1.2) 92 (1.4) 94 (1.3) 96 (1.1) 


97 (1.1) 87 (2.4) 65 (3.5) 98 (0.9) 
92 (2.0) 85 (2.5) 92 (2.1) 92 (1.9) 
89 (1.7) 84 (1.8) 87 (1.5) 89 (2.4) 
97 (1.2) 93 (1.7) 90 (2.2) 100 (0.0) 
81 (3.0) 72 (3.2) 74 (3.1) 82 (2.6) 
81 (2.1) 79 (2.0) 90 (1.5) 87 (1.6) 
94 (1.4) 85 (2.2) 75 (3.0) 85 (2.5) 
82 (3.6) 57 (3.8) 57 (3.5) 71 (4.1) 
rr 91(2.0) 6 89 (2.1) 6 91(2.1) Fr 87 (23) 


83 (2.4) 72 (2.9) 68 (2.8) 71 (2.4) 
67 (3.8) 53 (4.1) 68 (4.3) 71 (3.8) 
92 (2.0) 86 (2.9) 95 (1.8) 92 (1.9) 
92 (1.2) 89 (1.4) 90 (1.7) 87 (1.6) 
91 : : 89 ( = 91 = : 96 e 2 


Describe the Determine 
Style or the Author's 
Structure Perspective or 

of the Text Intention 


83 (2.4) 82 (2.1) 
25 (3.0) 20 (2.6) 
90 (2.2) 95 (1.5) 
80 (2.3) 77 (2.5) 
48 (3.6) 48 (3.6) 
45 (3.8) Al (4.1) 
95 (1.9) 92 (2.3) 
61 (2.5) 59 (2.5) 
96 (1.9) 89 (3.0) 
74 (2.9) 76 (3.2) 
Al (2.8) 39 (3.1) 
49 (4.1) 46 (4.2) 
82 (3.5) 78 (3.6) 
83 (3.4) 74 (4.0) 
20 (2.7) 15 (1.9) 
41 (3.7) 36 (4.2) 
94 (1.6) 98 (1.1) 
24 (2.9) 32 (3.0) 
71 (3.9) 79 (3.6) 
75 (3.4) 70 (3.5) 
77 (3.1) 70 (3.4) 
66 (4.0) 62 (3.9) 
92 (2.0) 88 (2.1 
83 (2.8) 78 (2.9 
98 (1.1) 100 (0.0 
75 (3.1) 68 (4.9 
55 (3.7) 67 (3.6) 
90 (2.1) 78 (3.0) 
62 (0.1) 63 (0.1) 
69 (0.1) 57 (0.1) 
66 (3.3) 56 (3.7) 
37 (4.4) 32 (4.2) 
70 (2.5) 66 (2.7) 
2 (4.3) 67 (4.2) 
29 (3.3) 21 (3.2) 
92 (1.8) 90 (2.1) 
86 (2.2) 87 (2.3) 
98 (1.1) 89 (2.1) 
87 (1.8) 80 (2.8 
90 (2.2) 99 (0.9 
78 (2.9) 63 (3.0 
66 (2.6) 62 (2.7 
62 (3.5) 72 (3.2) 
47 (3.9) 33 (3.8) 
r 87 (2.3) Fr 79 (3.1) 
61 (2.8) 51 (2.8) 
36 (3.9) 28 (3.8) 
64 (4.0) 69 (3.9) 
83 (1.8) 81 (2.0) 
82 . ° 85 S “ 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


) 
) 
) 
) 


) 
) 
) 
) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
An “r" indicates data are available for at least 70% but less than 85% of the students. An "s" indicates data are available for at least 50% but less than 70% of the students. 
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Exhibit 9.2: Teachers Develop Students’ Reading Comprehension Skills 


and Strategies (Continued) 


Locate 


Country Information 
Within 
the Text 


Benchmarking Participants 


Buenos Aires, Argentina 99 (0.9) 
Ontario, Canada 96 (1.7) 
Quebec, Canada 95 (2.3) 
Denmark (3) 85 (2.8) 
Norway (4) 99 (0.8) 


Moscow City, Russian Fed. —_100 (0.0) 
Eng/Afr/Zulu - RSA (5) r 96 (2.3) 


Andalusia, Spain 98 (1.0) 
Madrid, Spain 98 (0.9) 
Abu Dhabi, UAE 98 (1.1) 
Dubai, UAE 98 (1.0) 


Downloaded from http://pirls2016.org/download-center/ 


I. 


Percent of Students Whose Teachers Ask Them to Do the Following At Least Weekly 


Identify the 
Main Ideas 
Oa iets 
They Have 
Read 


96 (1.7) 
95 (1.9) 
79 (4.6) 
86 (2.9) 
93 (2.1) 
100 (0.0) 
93 (3.1) 
98 (1.0) 
99 (0.9) 
96 (1.6) 
98 (0.5) 


Explain or 
Support Their 
Understanding 
of What They 

Have Read 


98 (1.0) 
95 (1.9) 
84 (3.3) 
90 (2.4) 
83 (2.6) 
100 (0.0) 
r 96 (2.1) 
98 (1.1) 
100 (0.4) 
98 (1.2) 
99 (0.5) 


Compare 
What They 
Have Read 

with 
Experiences 
They Have Had 


71 (3.6) 
74 (3.4) 
95 (1.8) 
s 91 (3.2) 
83 (2.9) 
81 (3.4) 
91 (2.2) 
90 (1.4) 


Compare 
What They 
Have Read 
with Other 

Things They 
Have Read 


92 (2.5) 
81 (3.2) 
49 (5.2) 
57 (4.2) 
57 (3.8) 
90 (2.3) 
87 (4.1) 
73 (3.6) 
66 (4.0 
84 (3.3 
89 (1.3 


WEL 
Predictions 
About What 
Will Happen 

Next 
in the Text 


82 (3.4) 
94 (1.8) 
77 (4.1) 
61 (3.9) 
46 (3.6) 
84 (3.1) 
89 (3.1) 
73 (3.3) 
67 (4.1) 
91 (2.4) 
89 (1.8) 


Make 


Generalizations 


and Draw 
Inferences 


87 (2.7) 
90 (2.5) 
82 (3.9) 
51 (3.9) 
59 (3.4) 
99 (0.5) 
tr 92 (3.2) 
76 (3.4) 
72 (3.4) 
84 (3.4) 
91 (0.8) 


ZF 
iF 


Describe the 
Style or 
Structure 
of the Text 


84 (3.0) 
69 (4.4) 
62 (4.7) 
46 (4.0) 
40 (3.2) 
87 (2.8) 
t 77 (5.0) 
61 (3.9) 
56 (4.1) 
74 (4.1) 
87 (1.5) 


TIMSS & PIRLS 


Determine 
the Author's 
Perspective or 
Intention 


87 (2.8) 
66 (4.2) 
57 (5.5) 
35 (3.8) 
26 (2.9) 
96 (1.6) 


r 71 (5.2) 


58 (4.0) 
48 (4.0) 
81 (3.2) 
80 (2.2) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 9.3: Organizing Students for Reading Instruction 
Exhibit 9.3 provides information about how often teachers use different types of grouping for reading 
instruction. According to teachers’ reports, about one-third of the fourth grade students (32%) 
“always or almost always” are taught reading as a whole-class activity and most of the rest (65%) are 
“often or sometimes” taught as a whole class. Other grouping approaches—ability grouping, mixed- 
ability grouping, and assigning independent work—are used “often or sometimes” with substantial 


percentages of students (74, 79, and 81%, respectively) but “always or almost always” with fewer 
students (11, 13, and 14%). 
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Exhibit 9.3: Organizing Students for Reading Instruction 


Students Categorized by Teachers' Reports 


Country 


Australia 

Austria 
Azerbaijan 
Bahrain 

Belgium (Flemish) 
Belgium (French) 
Bulgaria 

Canada 

Chile 

Chinese Taipei 
Czech Republic 
Denmark 

Egypt 

England 

Finland 

France 

Georgia 

Germany 

Hong Kong SAR 
Hungary 

Iran, Islamic Rep. of 
Ireland 

Israel 

Italy 

Kazakhstan 
Kuwait 

Latvia 

Lithuania 

Macao SAR 

Malta 

Morocco 
Netherlands 

New Zealand 
Northern Ireland 
Norway (5) 

Oman 

Poland 

Portugal 

Qatar 

Russian Federation 
Saudi Arabia 
Singapore 

Slovak Republic 
Slovenia 

South Africa 
Spain 

Sweden 

Trinidad and Tobago 
United Arab Emirates 
United SEES 


Teach Reading asa 


Percent of Students Whose Teachers Organize Students in the Following Ways 


Whole-Class Activity 


Always or 
Almost 
Always 
14 (2.5) 
20 (2.7) 
31 (3.1) 
33 (2.6) 
3 (1.6) 
35 (3.7) 
60 (3.6) 
21 (1.7) 
66 (3.9) 
45 (3.4) 
19 (2.6) 
15 (2.7) 
52 (4.2) 
12 (2.7) 
26 (2.8) 
32 (3.4) 
32 (3.5) 
26 (2.9) 
28 (4.4) 
TW) 
64 (3.3) 
25 (3.3) 
40 (4.0) 
56 (4.0) 
76 (3.4) 
40 (4.2) 
51 (4.1) 
20 (2.6) 
28 (0.1) 
30 (0.1) 
38 (3.4) 
122) 
r 2 (1.0) 
r 6 (2.3) 
24 (3.0) 
32 (2.9) 
24 (3.5) 
41 (3.7) 
28 (3.0) 
51 (3.7) 
42 (4.0) 
33 (2.8) 
41 (3.3) 
15 (3.3) 
r 47 (3.4) 
55 (3.1) 
23 (3.5) 
26 (3.6) 
47 (2.3) 
28 ( = 


Often or 
Sometimes 


83 (2.9) 
75 (2.9) 
69 (3.1) 
66 (2.5) 
92 (2.1) 
64 (3.8) 
40 (3.6) 
78 (1.8) 
33 (3.8) 
55 (3.4) 
79 (2.8) 
85 (2.7) 
47 (4.2) 
85 (2.7) 
70 (2.8) 
65 (3.5) 
62 (3.6) 
72 (3.0) 
72 (4.3) 
93 (1.9) 
36 (3.3) 
74 (3.3) 
57 (4.2) 
44 (4.0) 
24 (3.4) 
53 (4.4) 
48 (4.0) 
75 (2.9) 
72 (0.1) 
68 (0.1) 
52 (3.5) 
84 (2.8) 
84 (2.5) 


76 (3.0 
62 (2.9 
68 (3.4 
59 (3.7) 
67 (3.1) 
49 (3.7) 
56 (4.0) 
67 (2.9) 
57 (3.4) 
82 (3.4) 
52 (3.4) 
45 (3.0) 
73 (3.6) 
74 (3.6) 
51 (2.3) 
72 us - 


J) 
) 
) 
) 


3 (1.2) 
5 (1.4) 

0 (0.3) 
1 (0.7) 
5 (1.4) 
1 (0.7) 
0 (0.0) 
1 (0.5) 
1 (0.9) 
0 (0.0) 
2 (1.0) 
0 (0.2) 
1 (0.5) 
3 (1.3) 
3 (1.1) 
3 (1.4) 
6 (1.7) 
2 (1.0) 
1 (0.7) 
0 (0.0) 
0 (0.0) 
1 (0.4) 
3 (1.5) 
0 (0.0) 
0 (0.0) 
8 (1.8) 
1 (0.6) 
5 (1.7) 
0 (0.0) 
2 (0.0) 
10 (1.8) 
9 (2.0) 
14 (2.3) 
9 (3.0) 
0 (0.2) 
6 (1.6) 
9 (2.0) 
0 (0.3) 
5 (0.8) 
0 (0.0) 
2 (1.2) 
0 (0.2) 
1 (0.7) 
3 (1.1) 
0 (0.3) 
0 (0.2) 
4 (17) 
0 (0.0) 

2 (0.7) 
0 ates 0) 


ENE 
Almost 
Always 
34 (3.3) 


10 (2.3) 
13 (2.0) 


11 (1.6) 
12 (3.2) 


18 (3.2) 
26 (3.3) 


6 (1.8) 


13 (2.7) 
18 (2.6) 
30 (4.8) 
2 (0.0) 52 (0.1) 
10 (1.7) 
17 (3.1) 
r 43 (3.3) 


55 (4.4) 44 (4.3) 


13 (2.0) 


19 (1.8) 


36 (3.6) 


r 20 (3.2 


35 (2.2) 
20 ( oe 


Create Same-Ability Groups 


62 (3.2) 
4 (1.3) 80 (3.1) 
82 (2.8) ) 
63 (3.9) 25 (3.9) 
83 (2.8) 12 (2.4) 

) 

2) 


15 ( ae 
8 (1.8 


5 (1.9) 
1 (0.5) 
6 (2.1) 


68 (4.1) 32 (4.0 
92 (24) 2(1. 

84 (1.8) 5 (1.0) 
74 (3.8) 14 (3.3) 
51 (4.5) 48 (4.5) 
83 (2.4) 17 (2.4) 
91 (2.3) 5 (1.7) 
63 (3.9) 19 (3.1) 
12563) MSA?) 
1 (0.7) 83 (2.4) 15 (2.4) 
78 (3.2) 16 (2.7 
80 (3.0) 14 (2.6 
86 (2.5) 12 (2.4 
60 (4.6) 40 (4.6 
2 (0.9) 93 (2.0) 5 (1.8) 
7 (1.8) 50 (4.0) 43 (3.7) 
9 (2.0) 79 (3.0) 13 (2.5) 
81 (3.2) 6 (2.0) 
70 (3.5) 29 (3.6) 
78 (2.9) 4 (1.5) 

) 
) 


1 (0.7) 
1 (0.6) 
5 (1.5) 


6 (1.7) 
2 (1.0) 
0 (0.0) 


2 (1.2) 


63 (5.0 7 (2.2) 
89 (2.0 7 (1.8) 
89 (2.4) 8 (2.3) 
47 (0.1) 
20 (0.1) 
20 (2.5 
11 (2.6 

2 (0.9 

1 (0.8 
19 (2.9) 
23 (2.9) 
23 (3.8) 
21 (2.8) 


3 (1.3) 
3 (0.9) 
7 (0.1) 74 (0.1) 
71 (2.9) 
71 (3.5) 
55 (3.2) 


3 (14) 78 (3.1) 
64 (3.0) 
1 (0.6) 76 (3.7) 
1 (0.4) 78 (2.8) 
66 (3.1) 15 (2.7) 
3(1.1) 96(1.4) 2 (0.9) 
56 (3.5) 8 (1.9) 
3(1.0) 77 (2.0) — 20 (2.1) 

1 (0.6) 85 (2.3) 14 (2.4) 
2 (0.8) 86 (2.5) 12 (2.4) 
) 70 (3.9) 10 (2.6) 
2 (0.7) 70 (2.1) 29 (2.0) 
2 (1.1) 82 (2.9) — 16 (2.8) 
7 (2.2) 83 (2.9) 10 (2.5) 
60 (2.2) 5 (1.0) 
77 ( 7 3 (1. 7 


Often or 
Sometimes 


Create Mixed-Ability Groups 


Always or 
¥ Often or 
Almost 
Sometimes 
Always 


7 (1.9) 87(2.5) 6 (1.5) 
4 (1.5) 85 (2.5) 11 (2.1) 
9 (1.8) 90(2.0) 1 (0.8) 
50 (3.4) 49(34) 0 (0.4) 
4(1.6) 88(2.6) 7 (2.0) 
5 (1.9) 73 (3.8) 22 (3.7) 
4 (1.2) 91(2.1) 5 (1.8) 
4(0.9) 91(16) 6 (1.3) 
16 (3.1) 72 (3.5) 13 (3.2) 
20 (3.0) 67 (3.5) 13 (2.2) 
2 (0.9) 90(2.2) 8 (2.0) 
3(1.1) 92 (21) 5 (1.8) 
24 (3.7) 65 (3.8) 11 (2.4) 
7 (1.9) 90 (2.3) 3 (1.2) 
4(1.7) 86 (2.3) 10 (2.0) 
3 (1.5) 67 (3.8) 29 (3.7) 
11(24) 86(26) 3 (1.1) 
30.9) 85 (2.8) 12 (2.6) 
20 (3.3) 72 (3.7) 8 (2.4) 
7(1.9) 91(2.2) = 2(1.1) 
44 (3.5) 49 (3.5) 7 (1.6) 
5 (1.6) 86 (2.6) 10 (2.1) 
12 (2.5) 83 (3.1) 5 (1.8) 
10 (2.7) 79 (3.6) 11 (2.4) 
14 (2.4) 85 (2.4) 1 (0.6) 
24 (37) 69 (4.1) 7 (2.2) 
4(1.4) 90 (2.6) 6 (2.1) 
6 (1.8) 93(1.9) 1 (0.6) 
19 (0.1) 73(0.1) 8 (0.1) 
6 (0.1) 77 (0.1) 16 (0.1) 
12 (23) 68 (3.0) 20 (2.6) 
7 (2.1) 80 (3.3) 14 (2.9) 
r 6(13) 83 (26) 11 (2.3) 
r 1(0.8) 87 (3.1) 12 (2.9) 
4(1.6) 87 (2.5) 9 (2.2) 
45 (3.2) 52 (3.1) 2 (0.8) 
14 (2.7) 81(3.6) 5 (2.4) 
8 (2.1) 83 (2.8) 9 (2.0) 
34 (18) 61(2.1) 4 (1.2) 
4(1.2) 95 (1.5) 2 (1.0) 
50 (3.8) 46 (3.6) 4 (1.3) 
23 (1.9) 79 (2.3) 8 (1.4) 
6(1.7) 86(2.1) 8 (1.6) 
9 (2.2) 84(28) 7 (1.8) 
128 (3.4) 69(3.4) 3 (13) 
8 (1.4) 71 (2.5) 22 (2.7) 
6 (2.0) 80 (3.0) 13 (2.7) 
10 (2.4) 87 (2.7) 4 (1.5) 
35 (2.1) 63 (24) 3 (0.9) 
9 a 4 88 u : 2 Me 


Have Students Work Independently 
onan Assigned Plan or Goal 


Often or 
Sometimes 


Always or 
Almost 
LENE 


13 (2.4) 
23 (2.9) 
22 (2.8) 
30 (3.4) 
4 (1.4) 

7 (2.1) 

25 (3.6) 
5 (1.0) 

23 (4.1) 
10 (2.2) 
1 (0.7) 

13 (2.8) 
15 (2.8) 
9 (1.9) 

6 (1.4) 
) 

) 


5 (1.7 
17 (28 
9 (1.9) 

3 (1.6) 
3 (1.3) 
20 (2.7) 
5 (1.7) 
22 (3.5) 
23 (3.4) 
44 (3.5) 
24 (5.1) 
8 (2.0 
Y(Qz 

9 (0.1 

7 (0.1 
25 (2.8) 
11 (2.7) 
r 14 (1.9) 
r 10 (2.5) 
6 (1.9) 
34 (2.7) 
10 (2.4) 
13 (2.7) 
23 (2.0) 
4 (1.5) 
30 (3.5) 
10 (1.4) 
12 (2.0) 
2 (1.0) 

r 33 (3.3) 
8 (1.9) 

6 (2.1) 

13 (2.6) 
30 (2.2) 
15 2 " 


84 (2.6) 2 (0.9) 
PG) | Ail} 
78 (2.9) 0 (0.3) 


69 (3.5) 1 (0.7) 
95 (1.4) 1 (0.4) 


84 (3.0) 9 (2.4) 
75 (3.6) 0 (0.0) 
92 (1.2) 3 (0.7) 


73 (4.2) 4 (1.8) 
85 (2.5) 5 (1.2) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


93 (1.8) 6 (1.6) 
78 (3.7) 9 (2.2) 
75 (3.2) 11 (2.4) 
87 (2.4) 4 (1.5) 
90 (1.9) 5 (1.4) 
68 (3.7) 28 (3.3) 
82 (2.7) 1 (0.5) 
86 (2.4) 5 (1.7) 
89 (2.9) 7 (2.5) 
97 (1.3) 0 (0.0) 
77 (2.7) 4 (1.2) 
88 (2.5) 7 (1.8) 
77 (3.6) — 2 (1.0) 
73 (3.4) 4 (1.4) 
56 (3.4) 1 (0.7) 
73 (5.1) 4 (1.4) 
91 (2.1) 1 (0.8) 
90 (2.3) 1 (0.8) 
85 (0.1) 6 (0.0) 
80 (0.1) 13 (0.1) 
61 (3.4) 14 (2.3) 
82 (3.2) 7 (2.1) 
82 (2.0) 3 (1.1) 
84 (3.0) 6 (1.9) 
86 (2.6) 8 (2.2) 
66 (2.8) 1 (0.4) 
90 (2.4) 0 (0.0) 
85 (2.8) 2 (1.0) 
74 (2.0) 3 (0.8) 
95 (1.6) 1 (0.6) 
65 (3.8) 5 (1.7) 
83 (2.0) 6 (1.3) 
88 (2.0) 0 (0.2) 
97 (1.3) 1 (0.8) 
66 (3.3) 0 (0.2) 
77 (2.4) 15 (2.3) 
85 (3.3) 8 (2.7) 
84 (3.0) 4 (1.5) 
68 (2.1) 2 (0.7) 
81 2 : 4 = 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
An "r" indicates data are available for at least 70% but less than 85% of the students. An "s" indicates data are available for at least 50% but less than 70% of the students. 
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Exhibit 9.3: Organizing Students for Reading Instruction (Continued) 


Teach Reading asa 
Whole-Class Activity 


en or 
Sometimes 


Country 


Always or 
Almost 
Always 


Benchmarking Participants 


Buenos Aires, Argentina 63 (3.9) 


Ontario, Canada 19 (3.3) 
Quebec, Canada 35 (4.5) 
Denmark (3) 14 (2.7) 
Norway (4) 20 (3.4) 


Moscow City, Russian Fed. 55 (4.0) 
Eng/Afr/Zulu - RSA (5) s 38 (5.1) 


Andalusia, Spain 60 (3.8) 
Madrid, Spain 57 (4.1) 
Abu Dhabi, UAE 44 (3.8) 
Dubai, UAE 36 (1.8) 


37 (3.9) 
80 (3.4) 
65 (4.6) 
86 (2.8) 
79 (3.4) 
45 (4.0) 
62 (5.1) 
40 (3.8) 
43 (4.1) 
56 (3.8) 
62 (1.9) 
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Percent of Students Whose Teachers Organize Students in the Following Ways 


0 (0.3) 
1 (1.2) 
1 (0.6) 
1 (0.8) 
1 (0.4) 
0 (0.0) 
0 (0.0) 
1 (0.5) 
0 (0.0) 
0 (0.2) 
2 (0.7) 


61 (3.9) 
82 (3.6) 
85 (3.3) 
90 (2.2) 
84 (2.8) 
95 (1.4) 
80 (4.1) 
64 (4.0) 
58 (3.8) 
54 (4.0) 
67 (2.7) 


Create Same-Ability Groups 


Often or 
i f 
é Sometimes 


28 (3.6) 
3 (1.5) 
11 (2.8) 
4 (1.2) 
8 (2.3) 
2 (1.3) 
11 (3.7) 
35 (3.9) 
40 (3.6) 
6 (1.9) 
5 (0.9) 


Create Mixed-Ability Groups 


Often or 
Sometimes 


64 (3.7) 
93 (2.4) 
85 (3.5) 
95 (1.6) 
88 (2.5) 
94 (1.9) 
75 (4.7) 
68 (3.6) 
64 (3.8) 
58 (4.4) 
69 (2.6) 


Have Students Work Independently 
onan Assigned Plan or Goal 


Always or 


Often or 
Almost ‘ 
Sometimes 
LENE 


29 (3.5) 65 (3.6) —6 (2.0) 
5 (1.7) 93 (1.9) 1 (0.8) 
4(1.7) 91 (3.0) 6 (2.4) 
8 (2.0) 84(2.9) 8 (2.2) 
5 (1.5) 88 (2.5) 7 (2.2) 
3(1.2) 96(1.4) 1 (0.7) 


119 (4.5) 77 (4.9) 3 (2.2) 


12 (2.4) 75 (3.6) — 13 (2.7) 

9 (2.1) 76 (3.4) 15 (3.0) 
26 (3.5) 72 (3.6) —‘1 (0.9) 
34 (2.5) 66 (2.6) —-1 (0.5) 
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Exhibit 9.4: Classroom Libraries 


A number of countries have invested in classroom libraries so that children can have ready access 
to books and magazines as part of the reading lessons and activities. Exhibit 9.4 presents teachers’ 
reports about the size and use of classroom libraries in their reading instruction, with the results 
ordered from high to low by the percentage of students with classroom libraries. There was 
substantial variation in the results, from a number of countries where almost all students (95-98%) 
had classroom libraries to countries such as Saudi Arabia, Norway, Sweden, Kuwait, Denmark, and 
Finland with 31 to 45 percent and Egypt with 14 percent. It is useful to consider the results about 
classroom libraries together with the results about central school libraries in Exhibit 5.5, because 
most students in the Nordic countries attend schools with sizable school libraries. 

On average, 72 percent of the fourth grade students were in classrooms with libraries, with 
about one-third (33%) in classrooms with libraries that had 50 books or more. Across the PIRLS 
countries, teachers reported that 61 percent of the students, on average, were given class time to use 
the classroom library and 55 percent could borrow books from it. 
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Exhibit 9.4: Classroom Libraries 


Students Categorized by Teachers' Reports 
For information about school libraries, see Exhibit 5.5 


Have a Classroom Library Percent of Students 


Whose Teachers 


Country 


United States 
Macao SAR 
Hong Kong SAR 
New Zealand 
Ireland 

Belgium (Flemish) 
Canada 

Malta 

France 

Chinese Taipei 
Spain 

Northern Ireland 
Belgium (French) 
England 

Australia 

Germany 
Singapore 
Lithuania 
Kazakhstan 
Netherlands 
Austria 

Italy 

Israel 

Russian Federation 
Czech Republic 
Slovenia 

Hungary 

United Arab Emirates 
Latvia 

Qatar 

Bulgaria 
Azerbaijan 

Slovak Republic 
Trinidad and Tobago 
Iran, Islamic Rep. of 
Georgia 

Oman 

Bahrain 

Chile 

South Africa 
Portugal 

Morocco 

Poland 

Finland 

Denmark 

Kuwait 

Sweden 

Norway (5) 

Saudi Arabia 

Egypt 


International Avg. 72 (0.4) 514 (06) 507 (12) 1 orn 32 (0.4) 61 (05) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A tilde (~) indicates insufficient data to report achievement. 


en 


n “r” indicates data are available for at least 70% but less than 85% of the students. An 
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3 Magazine Titles} to Use Classroom 


Classroom Library 


Take Them to 
Library Other 
than the 


At Least Once a 
Month 


94 (1.9) 
40 (0.1) 
59 (5.0) 
91 (2.0) 
43 (4.6) 
51 (3.2) 
93 (1.2) 
82 (0.1) 
47 (4.6) 
86 (2.8) 
52 (2.6) 
65 (4.5) 
46 (4.1) 
80 (2.8) 
93 (1.5) 
56 (3.8) 
50 (2.2) 
78 (3.2) 
95 (1.1) 
64 (3.9) 
69 (3.7) 
37 (3.5) 
61 (4.1) 
85 (2.6) 
40 (3.2) 
76 (2.5) 
69 (3.9) 
82 (2.0) 
70 (3.6) 
88 (1.0) 
76 (3.2) 
70 (3.1) 
56 (3.6) 
59 (3.8) 
40 (3.4) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


r 71 (3.2) 


89 (2.0) 
92 (1.7) 
57 (4.6) 


r 53 (3.8) 


72 (3.1) 
15 (2.1) 
70 (3.7) 
72 (2.8) 
92 (1.5) 
83 (2.9) 
71 (4.0) 
81 (3.4) 
54 (4.4) 
61 (4.1) 


(2. 
55(0.5) | 67 (0.5) | 


's” indicates data are available for at least 50% but less than 70% of the students. 
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Benchmarking Participants 


Quebec, Canada 


Ontario, Canada 
Andalusia, Spain 
Moscow City, Russian Fed. 


Abu Dhabi, UAE 
Eng/Afr/Zulu - RSA (5) 
Buenos Aires, Argentina 


98 (1.2) 
94 (1.9) 
90 (2.4) 
87 (2.9) 
78 (3.4) 
77 (2.6) 
75 (3.1) 
62 (5.8) 
59 (4.0) 
56 (3.9) 
52 (4.1) 
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546 (2.8) 
550 (2.1) 
543 (3.3) 
525 (2.3) 
611 (2.4) 
525 (2.5) 
407 (5.9) 
417 (9.6) 
469 (4.1) 
520 (3.0) 
503 (4.3) 


Exhibit 9.4: Classroom Libraries (Continued) 
Have a Classroom Library Percent of Students 


Percent of Wael 
Students Achievement 


Ene 


543 (7.0) 
560 (7.9) 
521 (5.3) 
617 (4.5) 
494 (6.2) 
444 (9.2) 


411 (13.7) 


493 (5.6) 
514 (2.7) 
498 (4.0) 


With More 
than 50 Books 
in Their 
Classroom 
Library 


82 (4.1) 
51 (3.9) 
78 (3.2) 
30 (3.8) 
31 (3.6) 
25 (1.7) 
34 (3.7) 
31 (5.1) 
13 (2.5) 
20 (3.3) 
18 (2.8) 


With At Least 


in Their 
Classroom 
Library 


50 (4.8) 
27 (3.8) 
45 (4.4) 
20 (3.3) 
55 (4.1) 
29 (2.2) 
32 (3.7) 
41 (6.4) 
37 (3.8) 
30 (3.3) 
12 (3.0) 


Given Class Time 
3 Magazine Titles} to Use Classroom 
Library At 
Least Once 

a Week 


98 (1.2) 
80 (3.4) 
89 (2.5) 
81 (3.2) 
32 (4.0) 
73 (2.9) 
71 (3.5) 
54 (6.3) 
50 (3.9) 
54 (4.1) 
50 (4.2) 


Who Can 
Borrow 
Books From 
Classroom 
Library 


76 (4.7) 
84 (2.8) 
73 (3.8) 
82 (3.3) 
75 (3.7) 
59 (3.2) 
61 (3.3) 
39 (6.0) 
48 (4.0) 
36 (3.5) 
36 (4.0) 
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Whose Teachers 
Take Them to 
Library Other 

than the 
Classroom Library 
At Least Once a 
Month 


92 (2.6) 
43 (4.3) 
90 (2.2) 
69 (3.6) 
82 (3.4) 
91 (1.3) 
84 (2.4) 
53 (5.8) 
77 (3.3) 
77 (3.4) 
94 (2.2) 


TIMSS & PIRLS 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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WAU CDP crade 
Exhibit 9.5 and 9.6: Types of Texts Assigned for Reading Instruction 


Consistent with the two overarching purposes for reading emphasized in the PIRLS 2016 Assessment 


Framework, PIRLS inquired of teachers how frequently they asked their students to read various 
types of literary and informational texts. 

Exhibit 9.5 presents information about the types of literary texts teachers ask students to 
read. Short stories were by far the most popular type of literary texts, assigned at least weekly for 
78 percent of the students on average. Longer fiction books with chapters were assigned to only 41 
percent of the students on a weekly basis, and few students were assigned plays (9%) this frequently. 

Exhibit 9.6 presents information about the types of informational texts teachers ask students 
to read. Nonfiction subject area books were the most common types of informational texts, assigned 
at least for 71 percent of the students on average. Nonfiction articles were assigned to 39 percent of 
the students and longer nonfiction books with chapters to only 24 percent. 
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Exhibit 9.5: Teachers Assign Literary Texts for Reading Instruction 


Students Categorized by Teachers’ Reports 


Country 


Percent Average Percent Average Percent Average Percent Average Percent Average Percent Average 
of Students | Achievement} of Students} Achievement} of Students | Achievement] of Students} Achievement of Students | Achievement] of Students] Achievement 


4 

3 
Australia 85 (2.4) 544 (2.9) 15 (2.4) 553 (6.7) 80 (2.4) 549 (2.8) 20 (2.4) 529 (6.5) 7 (1.8) 549 (7.7) 93 (1.8) 545 (2.7) 
Austria 78 (2.9) 544 (2.4) 22 (2.9) 533 (5.5) 15.425) | 537 (5,7) 85 (2.5) 542 (2.7) 2 (0.9) ~~ 98 (0.9) 542 (2.4) = 
Azerbaijan 86 (2.4) 477 (3.9) 14 (2.4) 441 (17.3) 29 (2.8) 479 (7.7) 71 (2.8) 469 (5.0) 13 (2.6) 460 (14.5) 87 (2.6) 475 (4.5) 5 
Bahrain 78 (2.3) 450 (3.3) 22 (23) | 432 (6.2) 24 (2.0) 469 (6.4) 76 (2.0) 440 (2.9) 9 (1.7) 460 (12.5) 911.7) 445 (2.8) 
Belgium (Flemish) 64 (3.9) 526 (2.5) 36 (3.9) 524 (3.6) 29 (3.7) 525 (5.0) 71 (3.7) 525 (2.2) 1 (0.6) ~~ 99 (0.6) 525 (2.1) 5 
Belgium (French) 71 (3.4) 499 (3.2) 29 (3.4) 495 (4.8) 13 (2.3) 496 (6.5) 87 (2.3) 498 (2.9) 0 (0.0) ~~ 100 (0.0) 498 (2.6) E 
Bulgaria 91 (2.3) 552 (4.4) 9 (2.3) 548 (13.3) 14 (2.3) 554 (9.2) 86 (2.3) 551 (4.7) 5 (1.6) 551 (17.1) 95 (1.6) 551 (4.5) 2 
Canada 76 (1.9) 543 (2.1) 24 (1.9) 545 (4.0) 69 (2.2) 547 (2.3) 31 (2). | 534025) 2 (0.8) ~~ 98 (0.8) 543(2.0) © 
Chile 98 (1.4) 497 (3.0) 2 (1.4) ~~ 19 (3.2) 497 (5.5) 81 (3.2) 497 (3.7) 11 (2.6) 490 (8.9) 89 (2.6) 498 (3.4) 
Chinese Taipei 67 (3.8) 559 (2.5) 33 (3.8) 558 (3.5) 20 (3.0) 569 (3.9) 80 (3.0) 556 (2.2) 7 (2.1) 559 (4.0) 9312.1) | 559(2.1) g 
Czech Republic 94 (1.5) 543 (2.0) 6 (1.5) 544 (9.7) 57 (3.3) 547 (2.5) 43 (3.3) 539 (4.0) 1 (0.6) ~~ 99 (0.6) 543 (2.2) = 
Denmark 74 (3.6) 548 (2.5) 26 (3.6) 546 (4.0) 55 (3.8) 551 (3.0) 45 (3.8) 544 (3.1) 1 (0.8) ~~ 99 (0.8) 549 (2.1) i 
Egypt 56 (4.5) 328 (7.6) 44 (4.5) 334 (10.2) 12 (2.8) 324 (19.6) 88 (2.8) 331 (6.3) 10 (2.8) 354 (21.2) 90 (2.8) 327 (6.0) § 
England 61 (3.9) 556 (2.7) 39 (3.9) 562 (3.8) 71 (35) 561 (2:5) 29 (3.5) 554 (4.0) 8 (2.0) 552 (7.3) 92 (2.0) 559 (2.3) 8 
Finland 72 (3.2) 565 (2.3) 28 (3.2) 569 (3.2) 50 (3.3) 566 (2.7) 50 (3.3) 567 (2.8) 2 (0.8) ~~ 98 (0.8) 566 (1.9) 
France 78 (3.2) 510 (2.7) 2213.2) | 517 (4.5) 53 (3.6) 514 (2.8) 47 (3.6) 509 (4.1) 7 (2A) | 530 (9:1) 93 (2.1) 510 (2.3) 
Georgia 93 (1.7) 491 (2.8) 7 (1.7) 457 (15.9) 31 (3.4) 490 (5.5) 69 (3.4) 488 (3.4) 5 (1.6) 497 (10.9) 95 (1.6) 489 (3.0) 
Germany 55 (3.4) 540 (4.9) 45 (3.4) 530 (5.3) 19 (2.8) 537 (5.9) 81 (2.8) 536 (4.2) 2 (1.0) ~~ 98 (1.0) 536 (3.6) 
Hong Kong SAR 55 (4.1) 570 (4.0) 45 (4.1) 567 (4.0) 8 (2.3) 573 (8.1) 92 (2.3) 568 (2.9) 3(1.4) 567 (20.4) 97 (1.4) 569 (2.8) 
Hungary 94 (2.1) 555 (2.8) (21) 525-011) 27 (3.4) 562 (6.4) 73 (3.4) 550 (3.5) 2 (1.0) ~~ 98 (1.0) 553 (2.7 
Iran, Islamic Rep. of 60 (3.4) 434 (6.7) 40 (3.4) 418 (7.9) 24 (2.7) 427 (8.7) 76 (2.7) 428 (4.8) 10 (2.4) 430 (14.6) 90 (2.4) 431 (4.7 
Ireland 88 (2.0) 567 (2.8) 12 (2.0) 565 (4.6) 76 (3.4) 564 (2.9) 24 (3.4) 575 (5.2) 1 (0.7) ~~ 99 (0.7) 567 (2.5 
Israel 88 (2.6) 531 (2.9) 12 (2.6) 526 (11.2) 39 (3.8) 549 (5.7) 61 (3.8) 518 (4.9) 8 (2.0) 497 (21.5) 92 (2.0) 532 (3.1 
Italy 94 (2.0) 550 (2.5) 6 (2.0) 538 (9.0) 41 (3.6) 550 (4.1) 59 (3.6) 549 (2.8) S27) | SADT) | 95. (17) | S502 4 
Kazakhstan 97 (1.2) 536 (2.5) 3(1.2) 529 (19.1) 84 (2.4) 536 (2.7) 16 (2.4) 538 (8.0) 65 (2.4) 527 (3.2) 35 (2.4) 551 (4.6) 
Kuwait 67 (4.0) 392 (5.3) 33 (4.0) 395 (8.0) 255.2) 397 (11,1) 75 (5.2) | 391 (5,7) 11 (3.0) 369(17.5) 89 (3.0) 396 (4.5) 
Latvia 89 (2.3) 558 (1.7) 11 (2.3) 557 (5.9) 26 (3.9) 563 (3.3) 74 (3.9) 556 (2.3) 3 (1.2) 542 (7.3) 97 (1.2) 559 (1.8 
Lithuania 79 (3.5) 550 (3.2) 21 BS) 543053) 30 (3.5) 556 (6.0) 70 (3.5) 545 (2.7) 10 (2.0) 555 (8.8) 90 (2.0) 548 (2.9) 
Macao SAR 77 (0.1) 549 (1.2) 23 (0.1) 535 (2.2) 21 (0.1) 559 (2.5) 79 (0.1) 542 (1.1) 7 (0.0) 563 (4.4) 93 (0.0) 544 (1.0) 
Malta 89 (0.1) 454 (1.9) 11 (0.1) 447 (4.0) 58 (0.1) 461 (1.9) 42 (0.1) 441 (2.7) 7 (0.1) 455 (6.1) 93 (0.1) 453 (2.0) 
Morocco 42 (3.1) 361 (7.0) 58 (3.1) 355 (5.5) 11 (2.5) 360 (13.2) 89 (2.5) 356 (4.3) 8 (1.6) 335 (18.4) 92 (1.6) 360 (4.0) 
Netherlands 55 (4.4) 543 (2.6) 45 (4.4) 548 (3.3) 95 (1.6) 545 (1.8) 5 (1.6) 541 (8.5) 6 (2.2) 561 (6.0) 94 (2.2) 544 (1.8) 
New Zealand 77 (2.4) 525 (2.9) 23 (2.4) 532 (5.2) 62 (3.3) 528 (3.3) 38 (3.3) 523 (5.2) 16 (1.8) 484 (7.7) 84 (1.8) 535 (2.2) 
Northern Ireland 60 (4.2) 570 (3.1) 40 (4.2) 555 (4.2) 90 (3.2) 562 (2.3) 10 (3.2) 581 (6.9) 4 (2.1) 570 (16.3) 96 (2.1) 564 (2.4) 
Norway (5) 64 (3.9) 559 (2.8) 36 (3.9) 558 (3.6) 80 (3.3) 559 (2.5) 20 (3.3) 559 (4.9) 0 (0.3) ~~ 100 (0.3) 559 (2.3) 
Oman 91 (1.9) 419 (3.5) 9 (1.9) 412 (9.8) 34 (2:5) 419: (5.2) 69 (2.5) 418 (4.6) 22 (2.8) 422 (5.2) 78 (2.8) 418 (3.9) 
Poland 96 (1.4) 564 (2.1) 4 (1.4) 585 (8.0) 22 (2.9) 564 (3.9) 78 (2.9) 565 (2.5) 3(1.2) 551 (10.2) 97 (1.2) 565 (2.2) 
Portugal 90 (2.1) 529 (2.4) TGH21) | | 5207.0) 26 (2.8) 536 (5.3) 74 (2.8) 525 (2.3) 13.1) | 542°(10.3) | 87 (3.1) | 526.42.2) 
Qatar 68 (2.6) 450 (3.8) 32 (2.6) 427 (6.3) 29 (2.1) 475 (5.4) 71 (2.1) 430 (3.1) 11 (1.3) 446 (9.9) 89 (1.3) 444 (2.3) 
Russian Federation 90 (2.2) 582 (2.4) 10 (2.2) 569 (9.5) 61 (3.2) 584 (2.9) 39 (3.2) 575 (3.4) 6 (1.5) 596 (11.6) 94 (1.5) 580 (2.4) 
Saudi Arabia 50 (3.8) 440 (6.6) 50 (3.8) 421 (6.4) 15 (3.0) 433 (14.3) 85 (3.0) 430 (4.9) 12 (3.0) 425 (15.5) 88 (3.0) 431 (4.6) 
Singapore 75 (2.1) 577 (3.9) 25 (2,1) 572 (5.4) 35 (2.8) 594 (5.5) 65 (2.8) 567 (3.9) 3 (0.9) 590 (13.6) 97 (0.9) 576 (3.2) 
Slovak Republic 93 (1.5) 534 (3.4) 7 (1.5) 541 (6.8) 26 (2.8) 552 (4.2) 74 (2.8) 529 (3.8) 5 (1.3) 556 (7.5) 95 (1.3) 534 (3.2) 
Slovenia 82 (2.6) 542 (2.3) 18 (2.6) 543 (3.4) 14 (2.6) 544 (3.5) 86 (2.6) 542 (2.1) 6 (2.1) 548 (5.6) 94 (2.1) 542 (2.0) 
South Africa tr 87 (2.3) 318 (5.1) 13 (2.3) 350 (20.6) r 39 (3.5) 302 (6.3) 61 (3.5) 335 (7.2) 1 45 (3.8) 295 (5.8) 55 (3.8) 344 (6.8) 
Spain 84 (2.0) 528 (2.0) 16 (2.0) 525 (3.9) 50 (3.2) 531 (1.9) 5013.2) | 525°(3.2) 9 (2.0) 526 (5.4) 91 (2.0) 528 (2.0) 
Sweden 62 (3.8) 556 (3.2) 38 (3.8) 554 (3.4) 93 (2.1) 555 (2.4) 7 (2.1) 563 (10.2) 3. (1.6) 552 (21.6) 97 (1.6) 555 (2.4) 
Trinidad and Tobago 92 (2.4) 479 (3.5) 8 (2.4) 491 (7.4) 44 (4.1) 498 (5.7) 56 (4.1) 465 (5.6) 7 (2.1) 490 (15.5) 93 (2.1) 478 (3.9) 
United Arab Emirates 85 (1.6) 451 (3.7) 15 (1.6) 464 (9.8) 36 (2.4) 472 (6.6) 64 (2.4) 442 (3.7) 22 (1.9) 460 (7.3) 78 (1.9) 451 (3.8) 
United States 77 (3.5) 547 (3.6) 23 (3.5) 556 (7.4) 70 (4.0) 557 (3.3) 30 (4.0) 531 (5.4) 6 (1.7) 536 (15.0) 94 (1.7) 550 (3.3) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A tilde (~) indicates insufficient data to report achievement. 
An “r" indicates data are available for at least 70% but less than 85% of the students. 
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Exhibit 9.5: Teachers Assign Literary Texts for Reading Instruction 
(Continued) 


Country Oncea Week or More | LessthanOnceaWeek OnceaWeekorMore | LessthanOnceaWeek{ OnceaWeekorMore | Less than Once a Week 


Percent Average Percent Average Percent Average Percent Average Percent Average Percent Average 
of Students | Achievement] of Students] Achievement { of Students | Achievement] of Students] Achievement of Students | Achievement} of Students} Achievement 


Benchmarking Participants 


zl 
2 
Buenos Aires, Argentina 89 (2.6) 479 (3.4) 11 (2.6) 474 (11.1) 54 (4.3) 480 (4.5) 46 (4.3) 478 (5.8) 20 (3.0) 479 (7.8) 80 (3.0) 479 (3.9) 2 
Ontario, Canada 76 (3.7) 543 (3.7) 24 (3.7) 547 (6.7) 69 (4.3) 548 (4.1) 31 (4.3) 535 (4.5) 4(1.6) 539 (12.6) 96 (1.6) 545 (3.4) & 
Quebec, Canada 87 (2.9) 547 (2.9) 13 (2.9) 546 (8.0) 58 (4.4) 552 (3.3) 42 (4.4) 539 (3.6) 0 (0.3) ~~ 100 (0.3) 547 (2.9) = 
Denmark (3) 77 (3.8) 503 (3.3) 23 (3.8) 496 (5.9) 57 (4.1) 504 (3.6) 43 (4.1) 497 (4.1) 1 (0.8) ae ee 99 (0.8) 501 (2.8) 8 
Norway (4) 78 (2.8) 518 (2.2) 22 (2.8) 513 (4.2) 69 (3.8) 518 (2.2) 31 (3.8) 514 (4.1) 4(1.5) 525 (7.5) 96 (1.5) 517 (2.1) 2 
Moscow City, Russian Fed. 87 (2.8) 613 (2.4) 13 (2.8) 607 (5.4) 55 (4.2) 616 (3.1) 45 (4.2) 607 (3.2) 7 (2.2) 616 (8.2) 93 (2.2) 612 (2.2) £ 
Eng/Afr/Zulu - RSA (5) r 89 (3.5) 412 (7.0) 11 (3.5) 425 (19.9) r 34 (6.0) 403 (14.9) 66 (6.0) 421 (8.7) r 32 (4.6) 394 (7.7) 68 (4.6) 424 (9.2) # 
Andalusia, Spain 83 (2.9) 526 (2.5) 17 (2.9) 516 (4.2) 55 (4.1) 525 (2.8) 45 (4.1) 524 (3.6) 10 (2.3) 510 (12.4) 90 (2.3) 526 (2.0) 3 
Madrid, Spain 86 (2.7) 549 (2.2) 14 (2.7) 550 (3.6) 59 (4.1) 548 (2.2) 41 (4.1) 552 (3.5) 5 (1.7) 550 (7.7) 95 (1.7) 549(2.1) 2 
Abu Dhabi, UAE 87 (2.9) 413 (4.9) 13 (2.9) 435 (18.8) 36 (4.2) 428 (10.8) 64 (4.2) 409 (6.5) 15 (2.2) 403 (10.4) 85 (2.2) 419 (5.5) re 
Dubai, UAE 85 (1.9) 519 (2.4) 15 (1.9) 513 (9.1) 49 (3.1) 531 (3.9) 51 (3.1) 505 (4.1) 24 (2.6) 517 (7.5) 76 (2.6) 518 (2.3) @ 
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Exhibit 9.6: Teachers Assign Informational Texts for Reading Instruction 


Students Categorized by Teachers' Reports 


Average Percent Average Percent Average Percent Average Percent Average 
Achievement] of Students} Achievement of Students Achievement § of Students | Achievement} of Students} Achievement 


Country 


Percent 
of Students 


: 

3 
Australia (2.6) 545 (2.9) 17 (2.6) 541 (8.4) 50 (3.3) 550 (3.2) 50 (3.3) 540 (4.1) 67 (3.4) 545 (3.1) 33 (3.4) 546 (5.4) 
Austria 72 (2.9) 542 (2.6) 28 (2.9) 540 (5.0) 17 (2.7) 539 (4.7) 83 (2.7) 542 (2.8) 52 (3.8) 539(3.3) 48 (3.8) 544 (3.2) 
Azerbaijan 63 (3.7) 479 (4.8) 37 (3.7) 460 (8.5) 18 (2.5) 4749.5) 82 (2.5) 471 (4.8) 44 (3.2) 485 (5.1) 56 (3.2) 463 (6.7) 5 
Bahrain 74 (2.8) 451 (3.6) 26 (2.8) 432 (6.8) 29 (2.6) 456 (6.3) 71 (2.6) 442 (2.9) 41 (43) 456 (47) 59 (43) 4393.7) & 
Belgium (Flemish) 38 (3.2) 525 (3.7) 62 (3.2) 526 (2.6) 13 (2.5) 524 (6.1) 87 (2.5) 525 (2.2) 31 (3.0) 521 (2.8) 69 (3.0) 527 (2.5) E 
Belgium (French) 40 (3.4) 503 (3.4) 60 (3.4) 494 (3.9) 6 (2.2) 494 (9.7) 94 (2.2) 498 (2.8) 41 (3.8) 500 (3.7) 59 (3.8) 496 (3.8) E 
Bulgaria 71 (3.3) 555 (5.1) 29 (3.3) 544 (8.0) 10 (2.1) 571 (8.6) 90 (2.1) 550 (4.7) 29 (3.1) 553 (8.3) 71 (3.1) 552 (4.9) z 
Canada 89 (1.5) 542 (2.1) 11. (1.5) 550 (4.0) 37 (2.5) 543 (3.1) 63 (2.5) 543 (2.3) 50 (2.3) 543 (2.7) 50 (2.3) 543 (23) = 
Chile 81 (4.0) 495 (3.2) 19 (4.0) 507 (7.2) 18 (3.7) 504 (7.2) 82 (3.7) 495 (3.6) 65 (4.9) 493 (3.9) 35 (4.9) 504 (5.2) @ 
Chinese Taipei 60 (3.8) 559 (2.7) 40 (3.8) 558 (2.7) 22 (3.5) 558 (4.6) = 78 (3.5) 559 (2.2) 49 (3.8) 557 (26)  51(3.8) 561(29) & 
Czech Republic 68 (3.4) 547 (2.3) 32 (3.4) 535 (4.4) 19 (2.7) 549 (3.9) 81 (2.7) 542 (2.5) 23 (2.7) 545 (4.6) = 77 (2.7) 543 (2.2) = 
Denmark 60 (3.3) 545 (2.8) 40 (3.3) 552 (3.3) 16 (2.6) 546 (7.3) 84 (2.6) 548 (2.1) 23 (3.1) 545 (3.8) 77 (3.1) 549 (2.5) i 
Egypt 60 (4.0) 329 (7.4) 40 (4.0) 334 (10.7) 18 (3.2) 308 (15.6) 82 (3.2) 335 (6.5) 30 (3.9) 337 (12.2) 70 (3.9) 327(7.1) §& 
England 67 (3.3) 556 (2.3) 33 (3.3) 564 (3.9) 33 (3.5) 556 (3.7) 67 (3.5) 560 (2.8) 51 (3.5) 555 (3.0) 49 (3.5) 562 (3.4) a 
Finland 93 (1.6) 567 (1.9) 7 (1.6) 562 (6.8) 11 (2.2) 569(5.7) 89 (2.2) 566 (2.1) 14 (2.1) 564 (3.8) 86 (2.1) 567 (2.0) 
France 55 (3.7) 512 (3.1 45 (3.7) 511 (3.5) 8 (2.3) 524 (11.4) 92 (2.3) 511 (2.1) 37 (3.7) 508 (3.9) 63 (3.7) 514 (2.9) 
Georgia 47 (3.9) 487 (4.1 53 (3.9) 490 (4.1) 11 (2.1) 489 (11.6) 89 (2.1) 489 (2.9) 24 (3.5) 497 (5.5) 76 (3.5) 486 (3.2) 
Germany 71 (3.4) 537 (5.3) —-29 (3.4) 533 (5.5) 12 (2.3) 542 (5.6) 88 (2.3) 536 (4.3) 49 (3.8) 542 (4.5) 51 (3.8) 530 (5.3) 
Hong Kong SAR 45 (4.5) 568 (4.6 55 (4.5) 570 (3.5) 10 (2.7) 560 (9.0) 90 (2.7) 570 (2.8) 37 (4.6) 564 (5.7) 63 (4.6) 571 (3.0) 
Hungary 74 (3.8) 550 (3.1 26 (3.8) 560 (7.5) 12 (2.7) 552 (8.9) 88 (2.7) 553 (3.1) 25 (3.1) 553 (5.6) 75 (3.1) 553 (3.7) 
Iran, Islamic Rep. of 52 (3.5) 432 (6.3) 48 (3.5) 424 (6.8) 22 (3.3) 417 (11.4) 78 (3.3) 432 (5.0) 26 (3.2) 429 (8.4) 74 (3.2) 428 (5.4) 
Ireland 83 (2.8) 565 (2.9) 17 (2.8) 572 (5.9) 33 (3.8) 565 (4.4) — 67 (3.8) 567 (3.5) 37 (3.6) 568 (3.5) 63 (3.6) +566 (3.2) 
Israel 75 (3.2) 540 (3.7 25 (3.2) 500 (9.3) 33 (3.9) 544 (7.0) 67 (3.9) 523 (4.0) 38 (3.9) 537 (6.0) 62 (3.9) 526 (4.3) 
Italy 66 (4.0) 550 (3.1) 34 (4.0) 547 (3.5) 26 (3.5) 545 (4.6) 74 (3.5) 551 (2.7) 23 (3.3) 546 (5.8) 77 (3.3) 550 (2.4) 
Kazakhstan 95 (1.5) 536 (2.5) 5 (1.5) 540 (11.8) 62 (3.7) 535 (3.4) 38 (3.7) 539 (4.5) 70 (3.5) 536 (2.6) 30 (3.5) 539 (6.2) 
Kuwait 67 (5.5) 388 (6.9) 33 (5.5) 402 (11.5) 23 (3.8) 404 (8.7) 77 (3.8) 389 (5.1) 34 (5.3) 402 (10.0) 66 (5.3) 387 (6.5) 
Latvia 68 (3.3) 562 (2.1) 32 (3.3) 551 (3.7) 9 (2.1) 565 (6.1) 91 (2.1) 557 (1.9) 22 (3.1) 562 (4.4) 78 (3.1) 557 (2.0) 
Lithuania 59 (3.5) 550 (3.7) 41 (3.5) 546 (3.9) 14 (2.7) 542 (6.8) 86 (2.7) 549 (2.7) 33 (3.6) 548 (4.7) 67 (3.6) 548 (3.4) 
Macao SAR 44 (0.1) 547 (1.4) 56 (0.1) 545 (1.5) 15 (0.1) 545 (3.1) 85 (0.1) 546 (1.3) 35 (0.1) 555 (1.7) 65 (0.1) 541 (1.2) 
Malta 68 (0.1) 455 (1.9) 32 (0.1) 449 (2.9) 34 (0.1) 460 (2.4) 66 (0.1) 449 (2.2) 28 (0.1) 452 (2.6) 72 (0.1) 453 (2.0) 
Morocco 57 (2.7) 367 (4.7) 43 (2.7) 345 (6.4) 15 (2.6) 353 (10.3) 85 (2.6) 358 (4.5) 15 (2.0) 375 (10.3) 85 (2.0) 354 (4.4) 
Netherlands 78 (3.5) 546 (2.1) 22 (3.5) 540 (4.4) 50 (4.8) 545 (3.3) 50 (4.8) 544 (3.0) 50 (4.0) 545 (2.7) 50 (4.0) 545 (2.5) 
New Zealand 83 (2.1) 527 (2.4) 17 (2.1) 526 (7.9) 38 (3.1) 523 (5.0) 62 (3.1) 528 (3.7) 65 (3.0) 527 (3.0) 35 (3.0) 526 (4.6) 
Northern Ireland 69 (3.6) 564 (3.0) 31 (3.6) 563 (4.4) 37 (4.8) 556 (4.6) 63 (4.8) 569 (2.8) 34 (4.1) 572 (4.8) 66 (4.1) 560 (2.9) 
Norway (5) 92 (2.2) 559 (2.4) 8 (2.2) 557 (6.0) 27 (3.1) 559 (4.4) 73 (3.1) 559 (2.3) 38 (4.1) 559 (3.2) 62 (4.1) 559 (3.0) 
Oman 82 (2.5) 419 (3.5) 18 (2.5) 417 (7.4) 27 (2.8) 426 (6.1) 73 (2.8) 416 (3.7) 44 (2.9) 423 (4.8) 56 (2.9) 415 (4.4) 
Poland 86 (2.8) 565 (2.4) 14 (2.8) 561 (6.5) 21 (3.3) 568 (5.2) 79 (3.3) 564 (2.4) 20 (2.9) 555 (5.1) 80 (2.9) 567 (2.5) 
Portugal 70 (3.6) 529 (2.1) 30 (3.6) +526 (6.8) 27 (3.1) 535 (4.3) 73 (3.1) 526 (3.0) 30 (3.5) 529 (4.3) 70 (3.5) 528 (3.3) 
Qatar 78 (3.3) 442 (3.3) 22 (3.3) 446 (8.4) 31 (3.1) 458 (7.2) — 69 (3.1) 438 (3.5) 36 (2.4) 457 (5.9) 64 (2.4) 436 (3.7) 
Russian Federation 75 (3.0) 585 (2.7) 25 (3.0) 567 (5.1) 32 (3.0) 594 (4.2) 68 (3.0) 574 (2.9) 38 (3.3) 590 (3.9) 62 (3.3) 575 (3.4) 
Saudi Arabia 63 (3.8) 437 (5.9) 37 (3.8) 420 (8.0) 20 (3.6) 428 (10.9) 80 (3.6) 432 (4.9) 28 (4.1) 431 (10.3) 72 (4.1) 430 (5.3) 
Singapore 59 (2.8) 576 (4.3) 41 (2.8) 577 (5.2) 21 (2.2) 579 (6.4) 79 (2.2) 576 (3.6) 45 (2.6) 584 (4.7) 55 (2.6) 570 (4.5) 
Slovak Republic 65 (3.5) 538 (4.4) 35 (3.5) 529 (5.4) 11 (2.1) 560 (8.2) 89 (2.1) 532 (3.3) 35 (3.4) 536 (6.0) 65 (3.4) 534 (3.5) 
Slovenia 90 (1.9) 542 (2.1) 10 (1.9) 541 (4.9) 8 (2.2) 550 (5.2) 92 (2.2) 542 (2.1) 25 (3.1) 544 (3.8) 75 (3.1) 542 (2.3) 
South Africa tr 73 (3.7) 318 (6.2) = 27 (3.7) 323 (9.0) =r «40 (3.4) 313 (7.3) 60 (3.4) 326 (6.4) =r 69 (3.5) 313 (63) 31 (3.5) 334 (10.0) 
Spain 84 (2.7) 528 (1.8) 16 (2.7) 528 (4.2) 33 (2.4) 527 (2.2) 67 (2.4) 528 (2.5) 39 (2.8) 527 (2.5) 61 (2.8) 528 (2.2) 
Sweden 84 (2.9) 556 (2.6) 16 (2.9) 554 (6.2) 28 (3.5) 553 (4.5) 72 (3.5) 556 (2.9) 34 (3.8) 550 (4.3) 66 (3.8) 558 (2.8) 
Trinidad and Tobago 90 (2.3) 481 (3.8) 10 (2.3) 466 (17.1) 44 (4.3) 496 (5.5) 56 (4.3) 467 (5.6) 48 (4.6) 481 (5.2) 52 (4.6) 478 (6.7) 
United Arab Emirates 78 (2.2) 451 (3.6) 22 (2.2) 456 (8.4) 35 (2.4) 467 (6.5) 65 (2.4) 445 (3.6) 51 (2.3) 457 (5.2) 49 (2.3) 448 (5.4) 
United States 94 (1.8) 550 (3.2) 6 (1.8) 541 (11.4) 33 (3.9) 545 (5.6) 67 (3.9) 551 (3.8) 79 (2.7) 550 (3.5) 21 (2.7) 548 (7.2) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
An “r" indicates data are available for at least 70% but less than 85% of the students. 
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Exhibit 9.6: Teachers Assign Informational Texts for Reading Instruction 
(Continued) 


Nonfiction Subject Area Books 


Longer Nonfiction Books with Chapters Nonfiction Articles 


Country OnceaWeek orMore | LessthanOnceaWeek OnceaWeekorMore | Less than Once a Week Once a Week or More | Less than Once a Week 


Benchmarking Participants 


Buenos Aires, Argentina 72 (3.8) 
Ontario, Canada 90 (2.3) 
Quebec, Canada 81 (3.8) 
Denmark (3) 56 (4.1) 
Norway (4) 92 (2.2) 
Moscow City, Russian Fed. _86 (3.0) 
Eng/Afr/Zulu - RSA (5) tr 74 (4.6) 
Andalusia, Spain 90 (2.6) 
Madrid, Spain 88 (2.6) 
Abu Dhabi, UAE 76 (4.1) 
Dubai, UAE 80 (2.1) 


Downloaded from http://pirls2016.org/download-center/ 


477 (3.8) 
544 (3.5) 
545 (3.1) 
499 (4.0) 
518 (1.9) 
613 (2.4) 
420 (7.3) 
526 (2.1) 
549 (2.1) 
408 (5.4) 
521 (2.3) 


28 (3.8) 
10 (2.3) 
19 (3.8) 
44 (4.1) 

8 (2.2) 
14 (3.0) 
26 (4.6) 
10 (2.6) 
12 (2.6) 
24 (4.1) 
20 (2.1) 


486 (7.5) 
550 (7.6 
556 (6.2 
503 (4.2 
509 (8.1 
605 (6.0) 

402 (16.6) 1 
519 (5.6) 

553 (4.5) 

438 (14.1) 
508 (6.4) 


) 
) 
) 
) 


28 (3.0) 


29 (3.5 
40 (2.1) 


481 (6.0) 
549 (5.4) 
544 (5.6) 
504 (7.8) 
518 (3.1) 
615 (3.7) 
406 (14.9) 
525 (3.1) 
547 (3.5) 
418 (10.4) 
535 (4.3) 


72 (3.0) 
61 (4.9) 
72 (4.4) 
87 (2.6) 
68 (3.7) 
61 (4.0) 
63 (5.7) 
58 (4.0) 
55 (3.4) 
71 (3.5) 
60 (2.1) 


478 (4.3) 
541 (3.9) 
548 (3.3) 
501 (2.8) 
517 (2.6) 
610 (2.7) 
419 (10.0) 46 
524 (2.9) 
551 (2.2) 
415 (6.0) 
506 (3.3) 


ZF 
iF 


58 (3.9) 
62 (4.1) 
30 (4.0) 
20 (3.6) 
44 (3.9) 
37 (3.8) 
61 (6.3) 
36 (4.0) 
33 (4.1) 
48 (4.2) 
55 (2.4) 


476 (4.5) 
547 (4.3) 
544 (6.1) 
496 (7.9) 
519 (3.0) 
618 (3.9) 
408 (9.2) 
525 (4.4) 
548 (3.5) 
412 (7.5) 
526 (3.6) 


Percent Average Percent Average Percent Average Percent Average Percent Average Percent 
of Students | Achievement} of Students} Achievement ofStudents | Achievement] of Students} Achievement § of Students | Achievement} of Students 


42 (3.9) 
38 (4.1) 
70 (4.0) 
80 (3.6) 
56 (3.9) 
63 (3.8) 
39 (6.3) 
64 (4.0) 
67 (4.1) 
52 (4.2) 
45 (2.4) 


Average 


Achievement 


483 (6.2) 
539 (4.9) 
548 (3.1) 
502 (3.0) 
516 (2.9) 
609 (2.7) 
424 (14.2) 
524 (2.2) 
550 (2.4) 
420 (8.4) 
508 (4.2) 
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Exhibit 9.7 and 9.8: Computers for Reading Lessons 


Exhibit 9.7 provides information about students’ access to computers as part of their reading 
lessons, and Exhibit 9.8 contains teachers’ reports about the prevalence and types of computer- 
based activities used as part of reading instruction. 

There was wide variation across the PIRLS countries in computer availability for use in reading 
lessons, from availability for most students (92-93%) in New Zealand and Denmark to availability 
for only a few students (6-8%) in South Africa, Belgium (French), and Morocco. Internationally, 
the fourth grade students with computers available for reading instruction had higher achievement 
(516 vs. 508), which also is likely to be related to socioeconomic factors. On average, relatively few 
students (10%) were in classrooms where every student had a computer, about one-fourth (23%) 
were in classrooms where students shared computers, and another one-third (36%) used computers 
available schoolwide. 

On average across countries, students were asked to engage in various computer-based activities 
on at least a weekly basis without any one instructional use predominating: read digital texts (19%), 
strategies for reading digital texts (13%), critique Internet text (17%), look up information (25%), 
research a problem (19%), and write something (17%). 
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Exhibit 9.7: Access to Computers for Reading Lessons 


Students Categorized by Teachers' Reports 


Country 


New Zealand 
Denmark 
Netherlands 
Sweden 

Northern Ireland 
Georgia 

Australia 

Finland 

United States 
Norway (5) 
Canada 
Germany 

Israel 

Russian Federation 
England 
Singapore 
Belgium (Flemish) 
Austria 

Malta 

Macao SAR 
Kazakhstan 
Bulgaria 

Qatar 

Ireland 

Iran, Islamic Rep. of 
Latvia 

Hungary 

Chile 

Hong Kong SAR 
United Arab Emirates 
Chinese Taipei 
Lithuania 

Spain 

Czech Republic 
Bahrain 

Saudi Arabia 
Poland 

France 

Oman 

Kuwait 

Italy 

Slovak Republic 
Azerbaijan 
Slovenia 

Egypt 

Portugal 

Trinidad and Tobago 
South Africa 
Belgium (French) 
Morocco 


r 


93 (1.6) 
92 (2.2) 
87 (2.6) 
83 (3.3) 
77 (3.6) 
75 (3.1) 
75 (3.1) 
72 (2.8) 
70 (3.8) 
66 (3.9) 
65 (1.8) 
65 (3.6) 
62 (4.2) 
56 (3.0) 
55 (4.0) 
55 (2.4) 
54 (3.6) 
53 (4.0) 
49 (0.1) 
49 (0.1) 
49 (3.5) 
48 (3.9) 
45 (3.2) 
39 (3.7) 
38 (3.8) 
37 (4.1) 
37 (4.0) 
36 (4.6) 
35 (4.1) 
34 (2.0) 
34 (3.6) 
30 (3.9) 
30 (2.0) 
29 (3.1) 
29 (2.6 
26 (3.1 
25 (3.0 
25 (3.4 
24 (2.2 
22 (3.4 
21 (3.4) 
19 (2.8) 
18 (2.7) 
17 (2.8) 
15 (3.1) 
14 (2.2) 
12 (2.6) 

8 (1.6) 

7 (2.1) 

6 (1.8) 


) 
) 
) 
) 
) 
) 


529 (2.5) 
548 (2.2) 
545 (1.9) 
558 (2.6) 
563 (3.0) 
487 (2.9) 
546 (3.0) 
566 (2.1) 
546 (3.6) 
558 (2.8) 
544 (2.5) 
539 (4.5) 
547 (4.6) 
588 (3.3) 
554 (3.0) 
584 (4.2) 
525 (2.9) 
537 (3.2) 
452 (2.3) 
548 (1.5) 
537 (3.6) 
548 (6.6) 
452 (4.6) 
564 (3.9) 
447 (7.2) 
557 (3.2) 
556 (5.4) 
494 (5.8) 
572 (4.6) 
494 (6.1) 
560 (3.7) 
548 (5.3) 
523 (4.6) 
540 (5.0) 
461 (5.6) 
423 (9.6) 
566 (4.4) 
515 (4.4) 
420 (6.6) 
400 (14.9) 
546 (5.8) 
543 (6.8) 
485 (9.1) 
541 (4.1) 
337 (18.3) 
524 (6.1) 
501 (10.0) 
372 (20.0) 
506 (7.1) 
406 (14.3) 


498 (15.9) 
540 (8.7) 
545 (5.3 
543 (5.3 
566 (4.4 
490 (6.7 
542 (4.9) 
566 (3.5) 
556 (5.7) 
561 (2.8) 
542 (2.4) 
531 (6.4) 
503 (6.3) 
572 (4.3) 
564 (3.4) 
567 (5.5) 
525 (2.9) 
546 (3.5) 
453 (2.1) 
543 (1.3) 
536 (4.1) 
554 (5.6) 
436 (3.5) 
568 (3.4) 
417 (5.8) 
558 (2.6 
553 (4.1 
499 (3.8 
566 (3.8 
431 (4.4 
559 (2.3 
548 (3.3) 
530 (1.9) 
545 (2.4) 
440 (3.3) 
433 (4.9) 
565 (2.6) 
511 (2.5) 
417 (3.6) 
392 (5.3) 
549 (2.8) 
533 (3.6) 
469 (4.9) 
543 (2.2) 
329 (6.3) 
529 (2.5) 
477 (3.9) 
316 (5.3) 
497 (2.8) 
354 (4.2) 


) 
) 
) 
) 


) 
) 
) 
) 
) 
) 


Each Student has 
a Computer 


r 


13 (2.5 
38 (3.7 
17 (3.4 
22 (4.0 
6 (2.2 
60 (2.9 
17 (2.6) 
9 (1.9) 
25 (4.0) 
9 (2.6) 
8 (0.9) 
3 (1.3) 
18 (3.3) 
9 (2.0) 
11 (2.2) 
31 (2.4) 
3 (13) 
1 (0.9) 
2 (0.0) 
18 (0.1) 
20 (2.6) 
4 (1.6) 
12 (1.0) 
2 (1.0) 
3 (1.4) 
10 (2.5 
4 (1.2 
16 (3.2 
14 (3.1 
16 (1.2 
7 (2.0 
3 (1.5) 
6 (1.1) 
6 (1.5) 
4 (1.0) 
3 (1.3) 
5 (1.6) 
2 (13) 
3 (0.8) 
6 (2.1) 
3 (1.6) 
8 (1.8) 
2 (0.8) 
4 (1.2) 
1 (0.7) 
1 (0.4) 
5 (1.9) 
1 (0.5) 
0 (0.0) 
0 (0.3) 


r 


83 (2.5) 
8 (2.1) 
79 (3.1) 
34 (4.4) 
58 (4.9) 
18 (2.9) 
58 (3.6) 
26 (3.4) 
51 (4.0) 
a (4.1) 
41 (2.0) 
48 (4.0) 
26 (3.9) 
21 (2.8) 
36 (3.3) 
20 (2.0) 
40 (3.7) 
48 (4.0) 
46 (0.1) 
23 (0.1) 
36 (3.5) 
16 (2.5) 
23 (2.7) 
18 (3.0) 
6 (1.9) 
13 (2.5) 
15 (2.8) 
17 (3.7) 
16 (2.8) 
19 (1.6) 
18 (2.8) 
14 (2.7) 
15 (1.6) 
12 (2.1) 
7 (1.5) 

8 (1.8) 

4 (1.4) 
15 (3.0) 
9 (1.7) 
3 (1.1) 
15 (2.9) 
7 (1.9) 
9 (2.1) 
10 (2.1) 
2 (0.9) 
6 (1.7) 
0 (0.0) 
1 (0.8) 
2 (0.9) 
1 (0.7) 


The Class has 
Computers that 
Students can Share 


r 


Computers Available for Students to Use 
A Percent of Students 
for Reading Lessons 
Percent Average 
of Students Achievement 


The School has 
Computers 
that the Class can 
Sometimes Use 


66 (2.8) 
64 (3.7) 
77 (2.9) 
54 (4.3) 
70 (3.7) 
65 (3.6) 
64 (3.3) 
70 (2.8) 
58 (4.4) 
60 (4.2) 
59 (2.2) 
52 (3.8) 
59 (4.3) 
50 (3.3) 
46 (4.0 
54 (2.4 
45 (3.4 
25 (3.7 
12 (0.1 
39 (0.1 
44 (3.3 
47 (3.9 
37 (2.6) 
33 (3.7) 
28 (3.5) 
37 (4.1) 
32 (3.7) 
36 (4.6) 
31 (4.0) 
29 (1.9) 
31 (3.4) 
27 (3.7) 
24 (1.9) 
27 (3.0) 
28 (2.6) 
20 (2.7) 
24 (2.9) 
20 (3.1) 
19 (2.2) 
18 (2.8) 
18 (3.2 
i (a 
16 (2.4 
17 (2.8 
14 (3.0 
12 (2.3 
8 (2.2) 
6 (1.5) 
6 (2.0) 

5 (1.7) 


) 
) 
) 
) 
) 
) 
) 
) 


) 
) 
) 
) 
) 
) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


International Avg. 43 (0.4) 516 (1.0) 508 (0.7) ORO) PERF) Bion (0) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
An “r" indicates data are available for at least 70% but less than 85% of the students. 
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Exhibit 9.7: Access to Computers for Reading Lessons (Continued) 


for Reading Lessons 
Country of Students Achievement 


pe fete 


Benchmarking Participants 


Denmark (3) 89 (2.8) 
Ontario, Canada 77 (3.5) 
Moscow City, Russian Fed. 76 (3.4) 
Norway (4) 64 (3.6) 
Dubai, UAE 61 (1.3) 
Buenos Aires, Argentina 56 (3.4) 
Quebec, Canada 45 (4.9) 
Madrid, Spain 35 (3.4) 
Andalusia, Spain 31 (3.8) 
Abu Dhabi, UAE 30 (3.1) 


Eng/Afr/Zulu - RSA (5) r 17 (4.7) 


Downloaded from http://pirls2016.org/download-center/ 


502 (2.9) 
546 (3.7) 
614 (2.4) 
521 (2.4) 
537 (2.6) 
463 (4.8) 
545 (4.2) 
551 (3.6) 
530 (3.2) 
466 (10.9) 
484 (21.0) 


492 (12.5) 
538 (5.6) 
607 (4.6) 
511 (3.4) 
488 (4.1) 
500 (5.0) 
548 (3.9) 
548 (2.3) 
522 (2.8) 
396 (4.8) 
402 (7.5) 


Each Student has 


r 


a Computer 


32 (3.8) 
6 (1.6) 
14 (3.0) 
7 (1.6) 
30 (1.4) 
39 (3.0) 
2 (1.1) 
8 (2.4) 
3 (1.4) 
14 (2.1) 
2 (1.8) 


r 


The Class has 


Computers that 
Students can Share 


9 (2.5) 
53 (4.3) 
37 (3.4) 
39 (3.5) 
37 (2.7) 
16 (3.0) 
28 (4.3) 
12 (2.7) 
12 (3.0) 
17 (3.0) 

4 (2.5) 


ZF 
iF 


that the Class can 


The School has 
Computers 


Sometimes Use 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 9.8: Computer Activities During Reading Lessons 


Students Categorized by Teachers' Reports 


Country 


Australia 
Austria 
Azerbaijan 

Bahrain 

Belgium (Flemish) 
Belgium (French) 
Bulgaria 

Canada 

Chile 

Chinese Taipei 
Czech Republic 
Denmark 

Egypt 

England 

Finland 

France 

Georgia 

Germany 

Hong Kong SAR 
Hungary 

Iran, Islamic Rep. of 
Ireland 

Israel 

Italy 

Kazakhstan 

Kuwait 

Latvia 

Lithuania 

Macao SAR 

Malta 

Morocco 
Netherlands 

New Zealand 
Northern Ireland 
Norway (5) 

Oman 

Poland 

Portugal 

Qatar 

Russian Federation 
Saudi Arabia 
Singapore 

Slovak Republic 
Slovenia 

South Africa 

Spain 

Sweden 

Trinidad and Tobago 
United Arab Emirates 
United States 


International Avg. 19 (0.4) em (3s) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Percent of Students Whose Teac! 


Ask Students to 
Read Digital Texts 


57 (3.1) 
13 (2.5) 
8 (1.8) 
17 (2.6) 
3 (1.4) 
1 (0.7) 
20 (2.6) 
30 (1.9) 
9 (2.5) 
7 (2.0 
4 (1.2 
40 (3.6 
8 (2. 

26 (3.4) 
21 (2.9) 
6 (1.9) 
34 (3.3) 
10 (2.3) 
20 (3.8) 
15 (2.7) 
16 (3.1) 
14 (2.5) 
45 (4.4) 
10 (2.7) 
37 (3.3) 
15 (3.2) 
6 (1.9) 
10 (2.6) 
21 (0.1) 
19 (0.1) 
2 (0.9) 
47 (4.5) 
57 (3.0) 
33 (4.5) 
25 (3.0) 
14 (2.1) 
5 (1.4) 
6 (1.7) 
28 (3.0) 
18 (2.6) 
17 (2.6) 
17 (1.8) 
6 (1.4) 
7 (1.9) 
r 4 (13) 
13 (1.9) 
28 (4.0) 
3 (1.4) 
25 (1.9) 
46 (4.3) 


) 
) 
) 
2) 


r 


Teach Students 
Strategies for 
Reading Digital 
Texts 


39 (3.4) 
9 (2.0) 
8 (1.6) 

15 (2.3) 
1 (0.7) 
1 (0.7) 

15 (2.8) 

16 (1.7) 
6 (2.0) 
5 (1.9) 
2 (0.8) 

13 (2.3) 
6 (1.9) 

13 (2.6) 
8 (1.5) 
3 (1.2) 

31 (3.1) 
4 (1.5) 
7 (1.8) 

13 (2.7) 

14 (3.1) 

10 (2.2) 

44 (4.4) 

10 (2.7) 

31 (3.0) 

12 (2.8) 
4 (1.6) 
7 (2.2) 

14 (0.1) 

15 (0.1) 
1 (0.7) 

31 (4.5) 

30 (2.6) 

14 (3.0) 
8 (1.9) 

13 (2.1) 
5 (1.2) 
4 (1.3) 

22 (3.0) 

11 (2.3) 

19 (2.7) 

13 (1.4) 
5 (1.4) 
2 (0.9) 
4 (1.3) 
8 (1.8) 

13 (3.3) 
3 (1.2) 

21 (1.9) 

30 (3.2) 


r 


(0 the Following Computer Activities in Reading Lessons at Least Weekly 


Teach 
Students to 
Be Critical When 
Reading on the 

Internet 


(3.2 
11 (2. 

9 (2.1 
14 (2.2 
10 (2.4) 

0 (0.4) 
20 (2.9) 
22 (1.8) 
10 (2.7) 

8 (2.3) 

6 (1.7) 
29 (3.3) 

3 (1.5) 
25 (3.4) 
28 (3.3) 

4 (1.4) 
35 (3.0) 

9 (2.2) 

9 (2.7) 
21 (3.2) 
16 (2.9) 
11 (2.7) 
44 (4.4) 
14 (3.0) 
35 (3.1) 
11 (2.9) 
10 (2.2) 

9 (2.4) 
17 (0.1) 
15 (0.1) 

2 (0.9) 
15 (2.5) 
44 (3.1) 
25 (4.1) 
29 (3.3) 
14 (2.3) 

9 (2.2) 

5 (1.3) 
22 (2.9) 
23 (2.6) 
17 (2.4) 
16 (1.7) 

8 (1.8) 

6 (2.2) 

2 (0.8) 
12 (1.6) 
31 (3.7) 
3 (1.2) 

) 
) 
) 


) 
2) 
) 
) 


20 (1, 
28 (3. 


8 
6 
17 (0.4 


An “r" indicates data are available for at least 70% but less than 85% of the students. 
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Ask Students to 
Look Up Information 
(e.g., facts, 
definitions, etc.) 


Ask Students 

to Research 

a Particular 
Topic or Problem 


Ask Students to 
Write Stories 
or Other Texts 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


59 (3.4) 50 (3.4) 51 (3.4) 
20 (2.8) 12 (2.3) 19 (3.0) 
12 (2.3) 9 (2.0) 10 (2.1) 
16 (2.4) 14 (2.3) 15 (2.2) 
20 (2.7) 10 (2.2) 5 (1.1) 
1 (0.7) 0 (0.1) 0 (0.3) 
31 (3.5) 22 (3.4) 4 (1.3) 
36 (1.9) 29 (1.7) 27 (2.2) 
15 (3.5) 9 (2.6) 11 (3.1) 
10 (2.5) 7 (2.1) 6 (1.9) 
12 (2.1) 13 (2.3) 5 (1.9) 
51 (3.8) 43 (3.8) 47 (3.6) 
8 (2.5) 6 (2.1) 4 (1.6) 
40 (3.4) 35 (3.5) 16 (2.5) 
32 (3.5) 24 (3.2) 22 (3.0) 
8 (2.1) 7 (2.0) 5 (1.7) 
54 (3.7) 16 (2.8) 33 (3.5) 
21 (3.0) 19 (2.9) 10 (2.1) 
12 (3.0) 7 (23) 6 (1.9) 
23 (2.9) 23 (3.4) 12 (2.6) 
26 (3.0) 27 (3.0) 22 (3.6) 
21 (3.0) 17 (2.6) 11 (2.3) 
47 (4.3) 25 (3.8) 29 (4.1) 
13 (3.0) 11 (2.6) 10 (2.8) 
42 (3.6) 36 (3.4) 39 (3.3) 
16 (3.2) 16 (3.2) 11 (2.8) 
20 (3.3) 8 (2.2) 9 (2.2) 
20 (3.4) 13 (2.6) 8 (2.2) 
20 (0.1) 11 (0.1) 11 (0.1) 
26 (0.1) 21 (0.1) 30 (0.1) 
3 (1.0) 3 (1.0) 1 (0.6) 
46 (4.4) 32 (3.9) 25 (3.8) 
78 (2.8) 70 (2.7) 64 (2.8) 
54 (5.1) 41 (4.9) 21 (3.6) 
33 (3.5) 22 (3.3) 31 (3.7) 
17 (2.3) 18 (2.2) 18 (2.4) 
10 (2.1) 8 (1.9) 2 (1.0) 
9 (2.2) 7 (1.8) 6 (1.6) 
31 (2.9) 26 (2.2) 24 (2.3) 
41 (3.2) 32 (3.3) 12 (2.2) 
20 (2.6) 18 (2.6) 15 (2.6) 
24 (2.2) 16 (1.9) 14 (1.9) 
9 (1.6) 7 (1.6) 4 (1.3) 
10 (2.4) 7 (2.2) 1 (0.8) 
r 4 (1.4) r 3 (0.8) r 3 (0.9) 
15 (2.3) 11 (1.9) 11 (1.8) 
32 (3.6) 27 (3.8) 46 (4.2) 
6 (1.8) 6 (1.9) 4 (1.5) 
26 (1.9) 22 (1.6) 20 (1.4) 
40 ~ : 26 e ; 37 = > 
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Exhibit 9.8: Computer Activities During Reading Lessons (Continued) 


Percent of Students Whose Tea 


Country 


Ask Students to 
Read Digital Texts 


Benchmarking Participants 


Buenos Aires, Argentina 27 (3.5) 
Ontario, Canada 39 (4.0) 
Quebec, Canada 10 (2.4) 
Denmark (3) 35 (3.7) 
Norway (4) 27 (3.2) 
Moscow City, Russian Fed. 24 (3.7) 
Eng/Afr/Zulu - RSA (5) r 4 (2.0) 
Andalusia, Spain 14 (3.1) 
Madrid, Spain 12 (2.6) 
Abu Dhabi, UAE 19 (3.3) 
Dubai, UAE 46 (1.7) 
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Teach Students 
Strategies for 
Reading Digital 
Texts 


23 (3.4) 
23 (3.5) 
2 (1.1) 
12 (2.4) 
16 (2.4) 
15 (2.9) 
1 (0.5) 
9 (2.6) 
8 (2.1) 
18 (3.2) 
35 (2.6) 


the Following Computer Activities in Reading Lessons at Least Weekly 


Teach 
Students to 
Be Critical When 
Reading on the 
Internet 


30 (3.6) 
30 (3.9) 

7 (2.5) 
16 (2.8) 
27 (3.4) 
33 (3.8) 
2 (0.9) 
14 (3.0) 
11 (2.5) 
15 (2.6) 
36 (2.2) 


Ask Students to 
Look Up Information 
(e.g., facts, 
definitions, etc.) 


37 (3.3) 
51 (4.4) 
11 (2.6) 
28 (3.9) 
33 (3.7) 
57 (4.1) 
r 3 (1.1) 
17 (3.2) 
13 (2.5) 
18 (3.0) 
49 (2.1) 


Ask Students 
to Research 

a Particular 
Topic or Proble: 


36 (3.3) 
43 (3.3) 

9 (2.7) 
21 (3.7) 
20 (3.3) 
39 (3.8) 
2 (0.5) 
12 (2.9) 
9 (2.1) 
15 (2.8) 
49 (2.2) 


ZF 
iF 


Ask Students to 
Write Stories 


or Other Texts 
m 


29 (3.4) 
33 (4.0) 
7 (2.1) 
42 (3.6) 
29 (3.4) 
17 (2.9) 
r 2 (1.1) 
13 (2.9) 
13 (2.4) 
15 (3.1) 
40 (1.9) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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PIRLS 
WAU Cp crade 
Exhibit 9.9: Classroom Instruction Limited by Student Attributes 


Exhibit 9.9 presents teachers’ reports about the extent to which their fourth grade classroom 
instruction in reading was limited by students’ preparedness and readiness to learn (i.e., lacking 
skills, sleep deprived, poor nutrition, absent, disruptive, uninterested, or with learning impairments). 
The results have been summarized on the Classroom Instruction Limited by Student Attributes scale. 
On average, across the PIRLS countries, about one third (34%) of the fourth grade students had 
classroom teachers who reported Very Little impact on their teaching due to students’ lack of 
preparedness or readiness to learn. Most of the rest of the students (63%) had teachers who reported 
that these student attributes led to Some limitations in their teaching. Unfortunately, 4 percent of 
students were in classrooms where teachers reported instruction was limited A Lot. As would be 
anticipated, there was a direct relationship between the degree that teaching was limited and average 
reading achievement, with successively lower achievement for each category of increased impact on 
teaching (528, 504, and 473, respectively). On average, reading achievement was 55 points higher 
for students whose teachers reported that teaching was limited Very Little compared to students 
whose teachers reported their teaching was limited A Lot. 


CHAPTER 9: CLASSROOM INSTRUCTION “ TIMSS & PIRLS 
International Study Center re 4 
PIRLS 2016 INTERNATIONAL RESULTS IN READING Gg IE ich cet ei 


Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


Students Categorized by Teachers' Reports 


Country 


A tilde (~) indicates insufficient data to report achievement. 
n “rc” indicates data are available for at least 70% but less than 85% of the students. 
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Exhibit 9.9: Classroom Instruction Limited by Student Attributes 


| Verylittle | | Verylittle | 


Average 


Achievement 


Percent of 
Students 


Students were scored according to their teachers’ responses about seven attributes of their students that could limit how they 
teach their class on the Classroom Instruction Limited by Student Attributes scale. Students with teachers who felt their teaching was 
limited Very Little had a score on the scale of at least 11.0, which corresponds to their teachers feeling “not at all” limited by four 
of the seven student attributes and to “some” extent by the other three, on average. Students with teachers who felt limited A Lot 
had a score no higher than 6.2, which corresponds to their teachers feeling limited “a lot” by four of the seven attributes and to 
“some” extent by the other three, on average. All other ee had teachers who felt their Es was limited to Some extent. 


Percent |__| Average Percent | _—_ Average 
Students Achievement Students Achievement 


Italy 550 (3.1 0 (0.0 
Netherlands 551 (2. . 2 (0.7 
Slovak Republic 548 (3.1) 1 (0.4 
Czech Republic 549 (2.4) 0 (0.0 
Kazakhstan 530 (3.7) 3(1.1 
Belgium (Flemish) 535 (2.2) 1 (0.4) 
Finland 572 (2.3) 0 (0.1) 
Norway (5) 569 (2.7) 0 (0.0 
Poland 573 (3.3) 1 (0.5 
Ireland 579 (3.0) 1 (0.8) 
Northern Ireland 575 (4.1) 1 (1.0) 
Azerbaijan 475 (5.8) 0 (0.3) 
Spain 537 (2.0) 3 (0.8) 
Macao SAR 554 (1.4) 2 (0.0) 
Germany 42 83 557 (3.0) 2 (1.0) 
Austria 4] (3.7 551 (2.9) 2 (0.9) 
Sweden (4. 562 (3.0) 1 (0.7) 
Singapore 38 (2. 610 (4.7) 3 (0.8) 
Bulgaria 38 (4. 575 (5.7) 1 (0.9) 
England 38 (3. 572 (3.1) 1 (0.9) 
New Zealand 551 (3.1) 3 (0.9) 
Hong Kong SAR 579 (5.3) 1 (0.8) 
Israel 556 (6.0) 14 (2.8) 
Hungary 574 (4.9) 2 (1.1) 
Georgia 496 (5.0) 6 (1.7) 
United Arab Emirates 498 (6.1) 3 (0.8) 
Malta 469 (2.3) 0 (0.1) 
Denmark 553 (3.4) 2 (1.0 
Australia 571 (4.8 4 (1.2 
Latvia 560 (3.2 6 (1.6 
Portugal 538 (5.7 4 (1.2 
France 529 (3.5 6 (1.9 
Qatar 479 (5.9 3 (0.7 
Bahrain 470 (7.2 3 (1.4) 
Belgium (French) 516 (4.6) 3 (0.8) 
Saudi Arabia 465 (8.3 0 (0.0 
Chinese Taipei 558 (3.6 1 (0.6) 
Lithuania 557 (4.8 9 (2.2 
Oman 436 (7.0) 15 (2.4) 
Trinidad and Tobago 524 (7.3 3 (1.5) 
Canada 561 (3.9) 4 (0.8) 
Iran, Islamic Rep. of 441 (9.5) 6 (1.6) 
Russian Federation 590 (6.2) 17 (2.5) 
United States 581 (4.8) 5 (1.8) 
Kuwait 414 (16.5) 3 (3.0) 
Slovenia 543 (3.6) 12 (2.5) 
Chile 537 (5.7) 8 (2.8) 
South Africa 342 (17.4) 4 (1.4) 
Morocco 419 (12.8) 6 (1.2) 
Egypt 384 (16.0) i u 2 


Average Scale 


Score 


11.3 (0.12) 
11.0 (0.16) 
11.3 (0.13) 
11.0 (0.09) 
10.9 (0.15) 
10.8 (0.13) 
10.9 (0.12) 
10.6 (0.16) 
10.7 (0.13) 
10.6 (0.14) 
10.7 (0.19) 
10.6 (0.10) 
10.4 (0.11) 
10.4 (0.00) 
10.2 (0.14) 

) 

) 

) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


10.3 (0.16 
10.5 (0.15 
10.2 (0.12 
10.4 (0.13) 
10.3 (0.12) 
10.1 (0.09) 
10.2 (0.12) 
9.5 (0.18) 
10.1 (0.18) 
9.9 (0.15) 
‘i 9 (0.08) 

.6 (0.01) 
7 (0.16) 

.9 (0.15) 

.8 (0.14 
" (0.12 
9.4 (0.14 
9.8 (0.07 
9.5 (0.10 
9.7 (0.11 
9.6 (0.13 
9.9 (0.10 
9.2 (0.13 
8.8 (0.13 
9.6 (0.15 
9.3 (0.09 
9.1 (0.13) 
8.6 (0.15) 
9.3 (0.13 
9.4 (0.17 
8.8 (0.16 
8.7 (0.16 
9.0 (0.10 
8.8 (0.09 
8.7 (0.12 


) 
) 
) 
) 
) 
) 


) 
) 
) 
) 
) 
) 


This PIRLS questionnaire scale was established in 2016 based on the combined response distribution of all countries that participated in PIRLS 2016. To provide a point of 
reference for country comparisons, the scale centerpoint of 10 was located at the mean of the combined distribution. The units of the scale were chosen so that 2 scale 
score points corresponded to the standard deviation of the distribution. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Benchmarking Participants 


Madrid, Spain 

Dubai, UAE 

Norway (4) 

Andalusia, Spain 
Denmark (3) 

Abu Dhabi, UAE 
Buenos Aires, Argentina 
Ontario, Canada 
Quebec, Canada 


Moscow City, Russian Fed. 


Eng/Afr/Zulu - RSA (5) 


1) Students lacking prerequisite knowledge or skills 


2) Students suffering from lack of basic nutrition 


556 (2.6) 
541 (3.1) 
522 (2.7) 
540 (2.3) 
510 (4.4) 
460 (11.9) 
506 (6.9) 
554 (7.2) 
573 (6.6) 
619 (5.2) 
431 (23.5) 


3) Students suffering from not enough sleep 


4) Students absent from class 
5) Disruptive students 


6) Uninterested students 


71 (3.4) 
57 (4.4) 
74 (4.4) 
73 (4.7) 
73 (3.6) 
86 (3.5) 


Exhibit 9.9: Classroom Instruction Limited by Student Attributes (Continued) 


Percent of Average Percent of Average Percent of Average 
Students Achievement Students Achievement Students Achievement 


540 (2.6) 
496 (3.6) 
514 (2.9) 
515 (3.0) 
498 (3.7) 
407 (6.1) 
473 (4.9) 
544 (3.4) 
541 (2.6) 
612 (2.5) 
413 (6.8) 


7) Students with mental, emotional, or psychological impairment ------ CO 
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Very 
Little 


OOO Ooo Os— 


Average Scale 


Score 


10.8 (0.13) 
10.8 (0.09) 
10.4 (0.14) 
10.4 (0.13) 
10.1 (0.14) 
9.4 (0.13) 
8.7 (0.19) 
9.6 (0.17) 
9.2 (0.19) 
8.8 (0.15) 
9.2 (0.17) 
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Exhibit 9.10: Frequency of Student Absences 
Exhibit 9.10 contains students’ reports about their absences from school. On average, many students 
(68%) reported that they were “never or almost never” absent. However, 17 percent reported monthly 
absences, 5 percent bi-weekly absences, and 10 percent weekly absences. Because coming to school 
is the foundation for having an opportunity to learn, it is not surprising that increases in frequency 
of being absent is highly related to decreases in average reading achievement, especially for the 
students absent as often as once every two weeks or more. Average reading achievement was 521 
for students “never or almost never” absent, 509 for absent “once a month,’ 476 for absent “once 


every two weeks,’ and 459 for absent “once a week or more” —a 62-point difference between full 
attendance and regularly being absent. 
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Students’ Reports 


Country 


Exhibit 9.10: Frequency of Student Absences 


Never or Almost Never 


Percent of 
Students 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
A tilde (~) indicates insufficient data to report achievement. 
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ite | Once Every TwoWeeks | Two | Once Every TwoWeeks | 


Once | OnceaWeekorMore | | OnceaWeekorMore | or More 


Percent of BWacl( Percent of Average 
Students Achievement Students Achievement 


Hong Kong SAR 89 (0.7) B 
Belgium (Flemish) 87 (0.7) a : - .. ~~ s 
Portugal 86 (0.7) 2 (0.3) 5 (0.4) 483 (6.1) 5 
Spain 85 (0.5) .! 3 (0.2) 5 (0.3) 482 (7.3) £ 
Chinese Taipei 83 (0.7) .5) 2 (0.2) 6 (0.5) 481 (5.2) & 
Lithuania 82 (0.7) 7) 2 (0.2) 6 (0.6) 495 (7.6) & 
Germany 82 (0.7) .5) 3 (0.3) 5 (0.4) 482 (7.4) = 
France 82 (0.8) .5) 3 (0.4) 5 (0.4) 461 (5.0) g 
Austria 82 (0.7) 2 (0.3) 5 (0.4) 479 (5.6) = 
Russian Federation 82 (0.8) 3 (0.3) 5 (0.3) 531 (6.0) % 
Belgium (French) 82 (0.7) 3 (0.3) 7 (0.5) 457 (4.7) 3 
Netherlands 82 (0.9) 2 (0.2) 6 (0.5) 499 (7.0) 2 
Macao SAR 82 (0.7) 2 (0.2) 4 (0.3) 474 (6.6) = 
Singapore 79 (0.8) 2 (0.2) 6 (0.5) 481 (5.6) Es 
Malta 79 (0.7) R 3 (0.3) 8 (0.5) 392 (5.9) 9 
England 76 (0.7) 5) 3 (0.2) 4 (0.3) 483 (7.5) 
Norway (5) 76 (0.8) 7) 3 (0.2) 4 (0.4) 528 (6.2) 
Sweden 75 (1.0) 8) 4 (0.4) 4 (0.4) 507 (7.9) 
Northern Ireland 75 (1.0) .8) 3 (0.4) 4 (0.4) 462 (8.7) 
Ireland 71 (1.0) .9) 3 (0.5) 5) 5 (0.4) 489 (6.2) 
Slovenia 71 (0.9) .8) 5 (0.4) 7) 8 (0.6) 496 (6.3) 
United States 71 (0.9) 5 (0.4) 6) 8 (0.6) 490 (5.8) 
Latvia 71 (1.0) 5 (0.5) 8) 7 (0.6) 529 (4.7) 
Italy 70 (0.8) 5 (0.4) 9) 9 (0.6) 509 (4.6) 
Canada 69 (0.7) 5 (0.3) 5) 7 (0.4) 486 (4.5) 
Oman 69 (0.9) 5 (0.3) 0) 13 (0.5) 380 (4.8) 
Denmark 69 (0.9) i 6 (0.4) .1) 4 (0.4) 516 (7.7) 
Morocco 69 (1.4) 3) 5 (0.3) 12 (0.7) 325 (5.5) 
Chile 66 (0.9) 5) 7 (0.5) 16 (0.9) 468 (4.2) 
Poland 66 (1.0) A) 6 (0.3) 9 (0.5) 520 (5.1) 
Bulgaria 66 (1.4) A) 13 (0.7) 9 (0.8) 484 (7.3) 
Australia 65 (1.0) 5) 6 (0.3) 6 (0.5) 467 (6.2) 
Israel 65 (1.0) 6) 6 (0.4) 12 (0.6) 464 (4.8) 
Iran, Islamic Rep. of 64 (1.5) 4 (0.4) 12 (0.7) 386 (7.0) 
Kazakhstan 63 (1.2) 4 (0.3) 15 (0.7) 506 (4.0) 
New Zealand 61 (0.9) 7 (0.4) 10 (0.6) 456 (5.6) 
United Arab Emirates 60 (0.8) 7 (0.3) 17 (0.6) 398 (4.2) 
Bahrain 59 (1.0) 6 (0.4) 19 (0.9) 402 (4.3) 
Trinidad and Tobago 57 (1.2) 9 (0.6) 23 (1.0) 445 (4.6) 
Qatar 57 (1.0) 8 (0.4) 19 (0.7) 392 (4.3) 
Finland 56 (1.0) 5 (0.4) 3 (0.4) 503 (7.5) 
Azerbaijan 55 (1.7) 6 (0.5) 15 (0.7) 441 (5.5) 
Saudi Arabia 51 (1.4) 9 (0.6) 25 (1.1) 405 (5.2) 
Czech Republic 51 (0.9) 7 (0.4) 9 (0.5) 495 (5.7) 
South Africa 51 (1.2) 9 (0.4) 28 (0.9) 299 (4.7) 
Hungary 50 (1.6) 6 (0.5) 8 (0.7) 489 (6.8) 
Kuwait 50 (1.5) 9 (0.7) 23 (1.1) 374 (6.0) 
Georgia 44 (1.3) 9 (0.5) 21 (0.8) 462 (4.3) 
Slovak Republic 43 (1.3) 9 (0.5) 14 (0.7) 476 (6.6) 
Egypt 41 (17) 10 (0.6) 27 (1.7) 314 (8.9) 
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Exhibit 9.10: Frequency of Student Absences (Continued) 


Benchmarking Participants 


Madrid, Spain 86 (0.7) 
Andalusia, Spain 85 (0.7) 
Quebec, Canada 80 (1.0) 
Moscow City, Russian Fed. 80 (0.8) 
Norway (4) 77 (0.7) 
Denmark (3) 73 (0.9) 
Buenos Aires, Argentina 67 (1.0) 
Ontario, Canada 66 (1.4) 
Dubai, UAE 64 (0.9) 
Eng/Afr/Zulu - RSA (5) 60 (1.5) 
Abu Dhabi, UAE 55 (1.3) 
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552 (2.1) 
529 (1.9) 
551 (2.9) 
613 (2.2) 
522 (2.2) 
507 (3.3) 
490 (3.0) 
549 (2.9) 
532 (2.1) 
427 (6.4) 
444 (4.9) 


Once | OnceaMonth = | OnceaMonth = 


7 (0. 

6 (0.5 
13 (0.7 
13 (0.6 
14 (0.7 
17 (0.9 
10 (0.4) 
20 (1.2) 
17 (0.6) 
12 (0.8) 
17 (0.8) 


5) 
) 
) 
) 
) 
) 


545 (4.6) 
512 (7.0) 
543 (5.2) 
613 (3.9) 
516 (3.7) 
495 (4.2) 
481 (6.4) 
552 (5.3) 
521 (3.6) 
403 (7.7) 
412 (7.7) 


ites | Once Every TwoWeeks | Two | Once Every TwoWeeks | 


3 (0.3) 
2 (0.2) 
3 (0.4) 
3 (0.4) 
3 (0.3) 
5 (0.4) 
7 (0.4) 
6 (0.5) 
6 (0.3) 
6 (0.5) 
8 (0.6) 


527 (6.9) 
537 (9.2) 
621 (5.4) 
500 (5.8) 
478 (6.6) 
473 (8.3) 
528 (9.2) 
477 (10.7) 
367 (9.2) 
350 (8.7) 


Z 
oS] 


_— 


Once | OnceaWeek orMore | | OnceaWeek orMore | or More 


Never | Neveror Almost Never | | Neveror Almost Never | Never 
Country Percent of Average Percent of Average Percent of Average Percent of Average 
Students Achievement Students Achievement Students Achievement Students Achievement 


4 (0.4) 
6 (0.5) 
4 (0.4) 
3 (0.3) 
6 (0.4) 
4 (0.4) 
16 (0.8) 
8 (0.6) 
14 (0.9) 
21 (1.2) 
20 (0.9) 


IEA 


506 (6.1) 
481 (6.1) 
504 (7.8) 
566 (7.6) 
469 (5.3) 
451 (7.9) 
448 (4.9) 
493 (6.8) 
452 (5.9) 
372 (6.6) 
369 (5.5) 


SOURCE: IEA's Progress in International Reading Literacy Study — 2016 
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Exhibit 9.11: Students Arrive at School Feeling Tired or Hungry 


Exhibit 9.11 contains students’ reports about arriving at school feeling tired or hungry. On average, 
across countries, only 18 percent of the students reported “never” arriving at school feeling tired. 
Half (50%) reported “sometimes” arriving feeling tired and about one-third (32%) reported that 
they felt tired “every day or almost every day,’ with the “sometimes” tired students having higher 
achievement (520 vs. 501). Interestingly, the “never” tired students had average achievement in 
between (509) the moderate and daily frequencies of being tired. Perhaps there are many reasons 
why students might be sometimes tired ranging from too many video games to demanding busing 
schedules or having to walk to school. 

Unfortunately, only one-third of the students (33%) reported that they “never” arrived at 
school hungry. Forty-one percent reported arriving at school hungry “sometimes” and one-fourth 
(26%) arriving hungry “every day or almost every day.” There was a direct relationship between 
the frequency of arriving at school hungry and average reading achievement. The “never” hungry 
students had an average of 526, the “sometimes” hungry students an average of 515, and the students 
hungry “every day” had an average of 494—32 points lower than “never” being hungry. 
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Students’ Reports 


Country 


Australia 

Austria 
Azerbaijan 
Bahrain 

Belgium (Flemish) 
Belgium (French) 
Bulgaria 

Canada 

Chile 

Chinese Taipei 
Czech Republic 
Denmark 

Egypt 

England 

Finland 

France 

Georgia 

Germany 

Hong Kong SAR 
Hungary 

Iran, Islamic Rep. of 
Ireland 

Israel 

Italy 

Kazakhstan 
Kuwait 

Latvia 

Lithuania 

Macao SAR 

Malta 

Morocco 
Netherlands 

New Zealand 
Northern Ireland 
Norway (5) 

Oman 

Poland 

Portugal 

Qatar 

Russian Federation 
Saudi Arabia 
Singapore 

Slovak Republic 
Slovenia 

South Africa 
Spain 

Sweden 

Trinidad and Tobago 
United Arab Emirates 
United States 


A dash (-) indicates comparable data not available. 
An “r" indicates data are available for at least 70% but less than 85% of the students. 
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Exhibit 9.11: Students Arrive at School Feeling Tired or Hungry 


Students Feel Tired Students Feel Hungry 
Every Day or Almost ; Every Day or Almost 
Never Sometimes 
Every Day Every Day 
Percent Average Percent Average Percent 
of Students | Achievement] of Students} Achievement] of Students 
( 


550 (2.7) 27 (0.9) 522 (3.5) 


Achievement] of Students} Achievement} of Students] Achievement 
56 (1.0) 553 (2.7) 31 (0.9) 534 (3.3) 
51 (0.9) 547 (2.8) 39 (1.0) 536 (2.8) 
44 (1.2) 477 (4.6) 20 (1.1) 445 (7.1) 
41 (1.0) 455 (3.0) 37 (1.1) 436 (3.1) 
60 (1.0) 529 (2.0 24 (0.8) 517 (3.0) 
51 (1.4) 563 (4.4 33 (1.5) 545 (4.8) 
50 (0.6) 552 (2.0 40 (0.7) 535 (2.7) 
46 (1.1) 506 (2.8 34 (0.9) 485 (3.5) 
55 (0.9) 563 (2.4) 18 (0.6) 557 (2.7) 
47 (0.9) 552 (2.3) 43 (0.8) 534 (2.4) 
55 (1.1) 553 (2.3 38 (1.3) 542 (3.1) 
54 (1.8) 340 (6.1) 17 (1.3) 307 (7.8) 
53 (0.9) 570 (2.3) 36 (0.9) 546 (2.6) 
63 (0.9) 573 (2.0) 31 (1.0) 552 (2.8) 
52 (1.1) 515 (2.5) 33 (1.4) 513 (3.1) 
51 (1.3) 493 (3.0) 27 (1.2) 475 (4.5) 
40 (1.1) 553 (3.5) 50 (1.1) 538 (2.9) 
53 (0.9) 571 (2.8) 25 (0.9) 562 (4.0) 
48 (1.1) 558 (3.2) 43 (1.3) 552 (3.1) 
42 (1.5) 444 (5.2) 19 (0.9) 413 (5.9) 
55 (1.1) 577 (2.4) 33 (1.2) 554 (3.2) 
45 (0.8) 544 (2.9) 41 (1.0) 525 (3.3) 
53 (1.0) 554 (2.3) 35 (0.9) 544 (2.9) 
47 (1.2) 541 (2.8) 17 (0.7) 519 (3.8) 
48 (1.6) 409 (4.2) 28 (1.2) 376 (7.6) 
54 (1.0) 562 (2.1) 36 (1.0) 551 (2.5) 
55 (1.2) 556 (2.7) 24 (0.9) 534 (3.7) 
57 (0.7) 548 (1.5) 23 (0.6) 537 (2.3) 
44 (0.8) 465 (2.2) 32 (0.8) 436 (3.1) 
43 (1.2) 377 (4.7) 19 (1.0) 332 (4.7) 
63 (1.1) 548 (1.8) 27 (1.0) 540 (2.8) 
49 (0.9) 540 (2.4) 43 (0.9) 518 (2.6) 
51 (1.2) 578 (2.6) 40 (1.3) 553 (2.9) 
52 (1.0) 569 (2.6) 40 (1.1) 548 (2.5) 
42 (0.9) 434 (4.1) 23 (0.9) 392 (4.4) 
48 (0.9) 576 (2.7) 33 (1.1) 549 (3.2) 
45 (1.0) 536 (2.8) 22 (0.9) 520 (3.1) 
45 (0.8) 460 (2.2) 35 (0.7) 427 (3.1) 
52 (1.0) 586 (2.6) 23 (1.0) 574 (3.0) 
52 (1.3) 440 (4.5) 25 (1.0) 413 (5.6) 
50 (0.7) 582 (3.3) 39 (0.7) 570 (3.6) 
49 (0.9) 541 (4.2) 42 (1.0) 532 (3.2) 
52 (1.0) 551 (2.5) 38 (1.0) 532 (2.6) 
31 (0.9) 352 (5.6) 33 (0.8) 304 (6.4) 
52 (0.7) 533 (1.6) 30 (0.7) 523 (2.7) 
55 (1.0) 561 (2.8) 37 (1.2) 548 (2.8) 
48 (1.3) 481 (3.7) 29 (1.2) 479 (4.7) 
46 (0.7) 462 (3.8) 31 (0.8) 435 (4.1) 
44 (1.0) 560 (3.5) 47 (1.0) 544 (3.4) 

( ) } 
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563 (3.7 45 (0.8) 
556 (3.0 44 (0.8) 
489 (4.2 39 (1.1) 
475 (3.7 36 (0.9) 
535 (2.2 40 (0.8) 
568 (4.5) 36 (1.1) 
558 (2.6 44 (0.7) 
514 (3.5) 43 (0.9) 
569 (2.6) 46 (0.8) 
560 (2.5) 38 (0.8) 
564 (2.8) 45 (0.9) 
342 (6.8) 36 (1.9) 
579 (2.6) 44 (0.8) 
581 (2.8) 55 (0.9) 
516 (3.4) 40 (1.0) 
505 (4.8) 42 (1.4) 
556 (3.2) 44 (1.0) 
573 (3.3) 47 (1.1) 
563 (3.9) 44 (1.1) 
440 (6.0) 42 (1.5) 
584 (2.7) 42 (1.0) 
537 (4.8) 42 (0.8) 
571 (2.5) 36 (0.9) 
543 (2.9) 44 (1.1) 
419 (6.4) 39 (2.5) 
569 (2.9) 50 (1.0) 
560 (3.3) 38 (1.2) 
549 (2.3) 49 (0.7) 
470 (3.0 32 (0.8) 
367 (5.8 41 (1.5) 
556 (2.1 44 (0.9) 
545 (4.0 38 (1.1) 
584 (3.2) 43 (0.9) 
570 (2.7) 49 (0.9) 
438 (3.5 36 (1.0) 
576 (2.4 25 (0.9) 
535 (2.7) 28 (0.8) 
469 (3.7) 40 (0.5) 
584 (2.7) 37 (1.0) 
453 (5.1) 44 (1.5) 
597 (3.5) 42 (0.7) 
548 (3.2) 42 (0.8) 
556 (2.8) 42 (1.0) 
331 (4.9) 33 (0.8) 
539 (1.8) 34 (0.7) 
573 (2.9) 45 (1.0) 
497 (4.5) 42 (1.1) 
479 (3.8) 41 (0.6) 
573 (3.8) 43 (0.8) 


Z 
<] 


= 


556 (4.8) 26 (1.5) 
547 (2.2) 31 (0.8) 
497 (3.1) 33 (0.9) 
556 (2.4) 14 (0.7) 540 (4.4) 
545 (2.7) 23 (0.7) 
544 (2.6) 20 (0.8) 
345 (7.6 ) 


430 (4.5 


542 (2.6) 25 (0.8) 523 (3.4) 
478 (4.3) 24 (1.3) 460 (5.2) 
454 (3.0) 39 (1.2) 430 (2.8) 
524 (2.3) 19 (0.7) 509 (3.4) 


Al (2.4 


) 
562 (2.3) 25 (0.8) 534 (2.9) 
571 (2.1) 22 (0.7) 541 (3.1) 
518 (2.7) 32 (1.2) 500 (2.8) 
492 (3.3) 35. (1.3) 484 (4.0) 
550 (2.8) 22 (0.8) 517 (5.1) 
569 (3.1) 22 (0.9) 564 (4.0) 
555 (3.7) 19 (0.9) 539 (4.3) 
432 (6.4) 23 (1.2) 412 (5.8) 
565 (3.3) 17 (0.7) 543 (4.2) 
544 (3.0) 37 (0.9) 518 (3.2) 
549 (2.7) 37. (1.2) 533 (2.9) 
534 (2.7) 14 (0.6) 528 (3.8 
403 (4.5) 37 (2.7) 380 (5.4 
562 (2.2) 26 (0.9) 542 (2.7 
546 (3.3) 13 (0.7) 522 (4.3 
547 (1.4) 20 (0.6) 539 (2.5) 
462 (2.5)  40(0.7) 437 (2.8) 
367 (4.0) 32 (1.4) 351 (5.5) 
542 (2.2) 17 (0.8) 528 (3.5) 
535 (2.9) 33 (1.1) 503 (3.2) 
571 (2.5) 25 (1.1) 533 (3.3) 
557 (2.8) 24 (1.0) 553 (3.5 
) 


585 (2.5) 17 (0.8) 570 (3.4) 
440 (4.6) 35. (1.3) 422 (5.5) 
577 (3.2) 24 (0.6) 548 (4.1) 
536 (4.7) 26 (1.0) 522 (4.1) 
545 (2.9) 24 (1.0) 523 (3.0) 
344 (4.6) 34 (0.9) 308 (4.9) 
528 (2.0) 25 (0.7) 513 (3.1) 
553 (2.8) 19 (0.9) 534 (3.7) 
485 (3.5)  30.(1.1) 462 (3.7) 
461 (3.8) 34 (0.7) 428 (4.1) 
556 (3.5) 36 (0.9) 536 (3.6) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Average 
Achievement 


531 (5.5) 
529 (2.6) 
484 (3.4) 


518 (3.5) 
528 (3.8) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


321 (6.5) 


31 (1.1) 398 (4.2 
563 (3.4) 16 (0.7) 535 (4.5 
525 (3.0) 14 (0.6) 511 (5.1 
459 (2.6) 37 (0.6) 424 (2.5) 


Exhibit 9.11: Students Arrive at School Feeling Tired or Hungry (Continued) 


Students Feel Tired 
cecdiee Every Day or Almost 
Country Every Day 


Students Feel Hungry 


: Every Day or Almost 
Sometimes 
Every Day 


Percent Average Percent Average Percent Average 
of Students | Achievement of Students] Achievement] of Students} Achievement 


Buenos Aires, Argentina -- -- -- -- -- -- -- -- -- -- -- - 


Percent Average Percent Average Percent Average 
of Students | Achievement of Students] Achievement] of Students} Achievement 


Benchmarking Participants 


SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 


Ontario, Canada 11 (0.8) 542 (7.1) 48 (1.1) 553 (3.6) 41: (1.3) 535 (4.0) 25 (1.3) 559 (4.2) 44 (1.4) 549 (4.1) 30 (1.7) 527 (4.0) 
Quebec, Canada 11 (1.0) 545 (5.9) 56 (1.4) 551 (3.3) 33 (1.3) 543 (3.6) 22 (1.4) 558 (4.4) 41.(1.0) 551 (3.1) 37. (1.5) 539 (3.8) 
Denmark (3) 10 (0.6) 511 (5.6) 53 (1.1) 508 (3.3) 38. (1.3) 489 (3.5) 34 (1.3) 519 (3.7) 45 (1.0) 503 (3.5) = 21 (1.0) 474 (4.9) 
Norway (4) 9 (0.7) 512 (4.8) 51.(1.1) 523 (2.4) 40 (1.1) 512 (2.6) 25 (1.2) 525 (2.8) 50 (1.2) 522 (2.4) = 25 (0.9) 500 (2.8) 
Moscow City, Russian Fed. 20 (0.9) 612 (3.0) 52 (0.9) 619 (2.4) 28 (1.0) 601 (2.8) 39 (1.0) 618 (2.5) 40 (0.9) 615 (2.8) 21 (0.8) 599 (2.9) 
Eng/Afr/Zulu - RSA (5) 29 (1.2) 394 (4.5) 45 (1.1) 427 (7.1) 25 (1.0) 396 (8.3) 33 (1.2) 414 (7.2) 39 (1.1) 418 (6.3) 27 (1.0) 394 (7.2) 
Andalusia, Spain 18 (0.9) 523 (3.5) 48 (1.0) 529 (2.1) — 34(1.1) 521 (2.9) 41 (1.1) 534 (2.5) 32 (1.0) 525 (2.5) 26 (1.0) 514 (2.8) 
Madrid, Spain 15 (0.8) 546 (3.8) 51 (1.0) 554 (2.1) 33 (1.1) 543 (2.9) 45 (1.2) 557 (2.3) 36 (1.0) 549 (2.9) 20 (0.8) 533 (3.1) 
Abu Dhabi, UAE 22 (1.0) 424 (5.0) 44 (1.1) 426 (5.8) 34.(1.2) 404 (5.9) 21 (0.9) 440 (6.8) 411.1) 428 (5.9) 38 (1.3) 400 (5.9) 
Dubai, UAE 22 (0.8) 518 (3.5) 48 (0.9) 526 (2.4) 30 (0.8) 501 (3.2) 29 (0.7) 534 (2.9) 42 (0.6) 525 (2.2) 29 (0.8) 489 (3.0) 
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Students' Attitudes Toward Reading 
The fourth grade students were very positive about their instruction and reading. 


Percent of 
students 


VERY 


Q) 5 % Engaged 


Almost all students 
were positive about 
their instruction. 


Average Achievement 


SOMEWHAT 
Engaged 


LESS THAN 
Engaged 


Percent of 
students 


VERY MUCH 
Like Reading 


84% 


Most students 
VERY MUCH liked SOMEWHAT 
or SOMEWHAT Like Reading 
liked reading. 
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Do NOT 
Like Reading 


Percent of 
students 


VERY Confident 
in Reading 


80% 


Most students were 

" SOMEWHAT 
VERY confident or Sorcdont in 
SOMEWHAT confident Reading 
in reading. 


Average Achievement 


NOT Confident 
in Reading 


; ; . : TIMSS & PIRLS 
SOURCE: IEA's Progress in International Reading Z I EA International Study Center 
Literacy Study — PIRLS 2016 ww Lynch School of Education 


http://pirls2016.org/download-center/ BOSTON COLLEGE 


PIRLS 
2016 Gp srade 


CHAPTER 10 


Student Engagement and Attitudes 


Exhibit 10.1: Students Engaged in Reading Lessons 

Exhibit 10.1 presents the results for the Students Engaged in Reading Lessons scale. Internationally, on 
average, 60 percent of the fourth grade students reported being Very Engaged during their reading 
lessons, another 35 percent reported being Somewhat Engaged, and only 5 percent reported being 
Less than Engaged. There was a positive relationship between students’ reports about being engaged 
and average reading achievement. Very Engaged students had higher achievement (516) than their 
counterparts that reported being only Somewhat Engaged (506), and students Less than Engaged 
had the lowest achievement (490). 


CHAPTER 10: STUDENT ENGAGEMENT AND ATTITUDES “ TIMSS & PIRLS 
International Study Center 29] 
PIRLS 2016 INTERNATIONAL RESULTS IN READING Gg IEA ice ae cet ia 


Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


Exhibit 10.1: Students Engaged in Reading Lessons 


Students’ Reports 

Students were scored according to their degree of agreement with nine statements on the Students Engaged in Reading Lessons 
scale. Students Very Engaged in reading lessons had a score on the scale of at least 9.5, which corresponds to their “agreeing a 
lot” with five of the nine statements and “agreeing a little” with the other four, on average. Students who were Less than 
Engaged had a score no higher than 7.1, which corresponds to their “disagreeing a little” with five of the nine statements and 
“agreeing a little” with the other four, on average. All other students were Somewhat Engaged in reading lessons. 


Very Engaged Somewhat Engaged Less than Engaged 
Average 


Scale Score 


Countr 
u Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Bulgaria 84 (1.1) 555 (3.9) 14 (0.9) 540 (8.5) 2 (0.3) aie 11.3 (0.06) 
Portugal 83 (0.8) 531 (2.4) 16 (0.8) 514 (3.4) 1 (0.2) po ee 11.1 (0.05) 
Azerbaijan 83 (1.0) 482 (3.6) 15 (0.9) 450 (6.1) 2 (0.3) ~~ 11.4 (0.06) 
Iran, Islamic Rep. of Bs (1.3) 434 (4.3) i (1.1) 410 (9.1) 3 (0.3) 360 (12.9) 11.3 (0.08) 
Georgia 80 (1.1) 496 (2.8) 9 (1.0) 469 (4.7) 1 (0.2) Aon 11.2 (0.06) 
Kazakhstan 80 (1.0) 537 (2.5) 8 (0.9) 534 (3.9) 2 (0.3) oe 11.2 (0.06) 
Egypt 79 (1.6 340 (5.6 9 (1.4 304 (9.9 2 (0.4 aie 10.9 (0.09) 
Oman 75 (1.2 430 (3.5 22 (1.0 395 (3.9 3 (0.3 348 (9.2 10.8 (0.06) 
Trinidad and Tobago 70 (1.6 486 (3.7 26 (1.4 467 (4.8 4 (0.4 441 (9.9 10.5 (0.08) 
Kuwait 70 (1.4 406 (4.0 27 (13 378 (6.3 4 (0.4 340 (10.2) 10.5 (0.07) 
Spain 70 (1.1 530 (1.4) 27 (1.0 525 (3.1 3 (0.2 513 (6.4) 10.4 (0.05) 
Morocco 69 (1.5 366 (4.4) 29 (1.4 345 (4.6 2 (0.2 ae 10.6 (0.07) 
Bahrain 68 (1.1 459 (2.6 28 (1.0 429 (3.3 5 (0.4 392 (9.3 10.4 (0.07 
Malta 67 (0.7) 465 (1.9) 29 (0.8) 435 (3.5) 4 (0.3) 387 (9.9) 10.3 (0.03 
Hungary 67 (1.3) 557 (3.3) 29 (1.2) 551 (3.3) 4 (0.4) 533 (7.3) 10.3 (0.06 
Russian Federation 65 (1.1 582 (2.5 32 (1.0 580 (2.8 3 (0.3 568 (6.8 10.2 (0.05 
South Africa 64 (1.3 337 (4.1 29 (1.0 301 (5.5 7 (0.5 268 (6.9 10.3 (0.06 
Saudi Arabia 63 (1.8) 446 (4.1) 32 (1.5) 416 (5.9) 5 (0.6) 375 (10.1) 10.3 (0.09 
United Arab Emirates 62 (0.8) 467 (3.2) 33 (0.7) 437 (4.3) 5 (0.2) 372 (8.3) 10.2 (0.04 
United States 62 (1.2) 556 (3.0) 32 (1.1) 549 (4.1) 6 (0.4) 521 (6.6) 10.1 (0.05 
Lithuania 62 (1.3) 554 (2.6) 35 (1.3) 544 (3.5) 3 (0.4) 503 (12.3) 10.0 (0.05 
Ireland 62 (1.4) 569 (2.6) 34 (1.2) 566 (3.3) 4 (0.5) 553 (8.4) 10.0 (0.06) 
Northern Ireland 61 (1.5) 567 (2.6) 34 (1.3) 566 (3.1) 4 (0.5) 539 (10.4) 10.0 (0.06) 
Qatar 60 (0.8) 462 (2.2) 32 (0.7) 431 (2.7) 8 (0.4) 384 (6.7) 10.1 (0.04 
Italy 59 (1.0) 552 (2.5) 37 (0.9) 544 (2.8) 4 (0.4) 530 (5.2) 9.9 (0.04) 
Canada 58 (0.8) 550 (2.2) 37 (0.7) 540 (2.5) 4 (0.3) 512 (5.1) 9.9 (0.03) 
Chile 58 (1.4) 503 (2.7) 32 (1.1) 494 (3.6) 10 (0.6) 461 (6.0) 9.9 (0.06) 
New Zealand 58 (1.0) 526 (2.3) 38 (0.8) 524 (3.1) 4 (0.4) 501 (8.2) 9.9 (0.04) 
England 57 (1.3) 562 (2.2) 38 (1.1) 558 (2.3) 5 (0.4) 530 (6.7) 9.8 (0.05) 
Australia 56 (1.2) 547 (2.7) 39 (1.1) 544 (3.3) 5 (0.3) 529 (5.8) 9.8 (0.04) 
Austria 56 (1.2) 542 (2.5) 37 (1.0) 542 (2.9) 6 (0.5) 529 (6.0) 9.8 (0.05) 
Israel 55 (1.6) 527 (3.1) 36 (1.3) 538 (3.7) 9 (0.9) 529 (7.6) 9.8 (0.08) 
Latvia 53 (1.3) 558 (2.3) 42 (1.2) 560 (2.2) 4 (0.5) 542 (6.6) 9.7 (0.05) 
Norway (5) 53 (1.5) 563 (2.5) 42 (1.3) 556 (2.9) 4 (0.5) 548 (6.3) 7 (0.05) 
Germany 52 (1.4) 552 (2.5) 42 (1.2) 539 (3.6) 7 (0.6) 504 (8.8) 6 (0.06) 
Belgium (French) 51 (1.4 497 (3.3) ( 501 (2.8 7 (0.9 483 (5.7 9.6 (0.06) 
Slovak Republic 51 (1.3 531 (4.6 43 (1.2 540 (3.2 6 (0.5 532 (5.1 9.6 (0.05) 
Belgium (Flemish) 49 (1.2 527 (2.5 47 (1.1 525 (2.2 4 (0.3 505 (6.5 5 (0.05) 
Sweden 49 (1.2 559 (3.1 ( 555 (2.9 4 (0.5 537 (5.1 5 (0.05) 
Slovenia 49 (1.1 540 (2.9 46 (1.0 546 (2.3 5 (0.6 539 (7.6 9.6 (0.05) 
Poland 49 (1.3 562 (2.3 45 (1.1 570 (3.0 6 (0.5 552 (5.9 9.5 (0.05) 
France 48 (1.5 510 (2.4 47 (1.4 515 (2.8 5 (0.5 500 (8.1 9.5 (0.06) 
Czech Republic 48 (1.0 540 (2.8 46 (1.0 550 (2.1 6 (0.4) 527 (5.2 9.5 (0.04) 
Chinese Taipei 48 (1.5 564 (2.1 43 (1.1 558 (2.8 9 (0.7 542 (4.4 9.5 (0.06) 
Macao SAR 44 (0.8 551 (1.6 47 (0.8 544 (1.3 9 (0.5 529 (4.5 9.3 (0.03) 
Singapore 43 (0.8) 579 (3.6) 50 (0.7) 578 (3.2) 8 (0.5) 555 (5.3) 9.2 (0.04) 
Denmark 41 (1.5) 560 (2.6) 51 (1.2) 543 (2.3) 8 (0.7) 523 (5.5) 9.2 (0.05) 
Finland 39 (1.2 569 (2.6 54 (1.1 568 (1.9 7 (0.5 539 (5.3 9.1 (0.04) 
Netherlands 37 (13 549 (2.2 56 (1.2 545 (2.0 7 (0.6 528 (5.0 9.0 (0.05) 
Hong Kong SAR 34 (1.2) 574 (3.6) 52 (1.1) 572 (2.6) 14 (1.1) 548 (7.0) 8.9 (0.06) 


International Avg. oo) a) EE) BS) ED) 


This PIRLS questionnaire scale was established in 2016 based on the combined response distribution of all countries that participated in PIRLS 2016. To provide a 
point of reference for country comparisons, the scale centerpoint of 10 was located at the mean of the combined distribution. The units of the scale were chosen 
so that 2 scale score points corresponded to the standard deviation of the distribution. 

() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 

A tilde (~) indicates insufficient data to report achievement. 
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Exhibit 10.1: Students Engaged in Reading Lessons (Continued) 


Very Engaged Somewhat Engaged Less than Engaged 
Counin Average 
i Percent Average Percent Average Percent Average Scale Score 
of Students Achievement of Students Achievement of Students Achievement 


Benchmarking Participants 


Andalusia, Spain 77 (1.2) 
Madrid, Spain 69 (1.4) 
Dubai, UAE 66 (1.0) 
Eng/Afr/Zulu - RSA (5) 64 (1.6) 
Buenos Aires, Argentina 61 (1.2) 
Norway (4) 59 (1.5) 
Abu Dhabi, UAE 58 (1.6) 
Ontario, Canada 57 (1.3) 
Moscow City, Russian Fed. 56 (1.1) 
Quebec, Canada 55 (1.7) 
Denmark (3) 46 (1.5) 


526 (2.1) 
549 (2.1) 
526 (2.2) 
412 (5.0) 
486 (3.4) 
521 (2.6) 
433 (4.9) 
552 (3.6) 
613 (2.4) 
551 (3.3) 
504 (3.5) 


21 (1.1) 
27 (1.1) 
31 (0.9) 
31 (1.4) 
33 (1.1) 
37 (1.2) 
36 (1.4) 
38 (1.3) 
40 (0.9) 
AI (1.6) 
48 (1.3) 


524 (3.6) 
550 (3.1) 
505 (2.9) 
405 (10.2) 
482 (4.1) 
514 (2.5) 
403 (6.5) 
540 (4.0) 
613 (2.6) 
545 (3.5) 
501 (3.2) 


How much do you agree with these statements about your reading lessons? 


1) | like what | read about in school 


2) My teacher gives me interesting 
things to read 


3) | know what my teacher expects me to do 


4) My teacher is easy to understand 


5) lam interested in what my teacher says 


6) My teacher encourages me to say what | 


think about what | have read 


7) My teacher lets me show what | have learned 


8) My teacher does a variety of things to help 


us learn 


9) My teacher tells me how to do better when 


| make a mistake 
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Agree 
alot 


Agree 
alittle 


2 (0.3) 
4 (0.5) 
3 (0.2) 
5 (0.5) 
5 (0.5) 
4 (0.5) 
6 (0.5) 
5 (0.6) 
4 (0.4) 
4 (0.5) 
6 (0.5) 


nate 10.8 (0.06) 
540 (6.3) 10.4 (0.07) 
432 (8.7) 10.4 (0.04) 
374 (12.3) 10.2 (0.08) 
468 (7.1) 10.0 (0.06) 
496 (7.0) 9.9 (0.06) 
353 (10.1) 10.0 (0.07) 
506 (7.8) 9.8 (0.05) 
598 (6.6) 9.7 (0.04) 
530 (7.8) 9.8 (0.06) 
478 (8.3) 9.4 (0.05) 


Disagree Disagree 


alittle alot 


v Vv v 
Oe O00 


Om Oe OO 
OO =O =O 
Om Oe OO 
Om Oe OO 


Om Oe OO 
OOOO 


Om OO 


Om 0 een OO 
— 


Very 
Engaged 
9.5 


Somewhat 
Engaged 


Zell 


| Less than Engaged 


ZF 
iF 
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Exhibit 10.2: Students Like Reading 


Considerable research indicates that positive attitudes toward reading and high achievement are 
related, and in a bidirectional way. That is, because better readers enjoy reading more than poorer 
readers, they may read more often than poorer readers, and thereby develop more advanced 
comprehension skills and strategies. Exhibit 10.2 presents the results for PIRLS 2016 Students Like 
Reading scale. On average, 43 percent of the fourth grade students reported that they liked to read 
Very Much and another 41 percent reported that they liked it Somewhat, although 16 percent 
reported they Do Not Like reading. On average and in almost every country, students who liked 
reading Very Much had higher average reading achievement (523) than those who only Somewhat 
liked reading (507); and in particular, those students who reported they Do Not Like reading had 
the lowest average reading achievement (486). Students who Very Much Like to read had a 37-point 
advantage compared to students who Do Not Like reading. 
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Exhibit 10.2: Students Like Reading 


Students’ Reports 


Students were scored on the Students Like Reading scale according to their degree of agreement with eight statements and how 


often they did two reading activities outside of school. Students who Very Much Like Reading had a score on the scale of at least 


10.3, which corresponds to their “agreeing a lot” with four of the eight statements and “agreeing a little” with the other four, as 
well as doing both reading activities outside of school “every day or almost everyday,” on average. Students who Do Not Like 
Reading had a score no higher than 8.3, which corresponds to their “disagreeing a little” with four of the eight statements and 
“agreeing a little” with the other four, as well as doing both reading activities only “once or twice a month,” on average. All other 
students Somewhat Like Reading. 


Country 


Portugal 
Kazakhstan 


Iran, Islamic Rep. of 


Oman 
Azerbaijan 
Georgia 
Saudi Arabia 
Kuwait 
Morocco 
Spain 

Egypt 
South Africa 
Bulgaria 
Bahrain 


United Arab Emirates 


Malta 


Trinidad and Tobago 


Qatar 

Russian Federation 
Ireland 

New Zealand 
Israel 

Australia 
Lithuania 

Italy 

France 

Northern Ireland 
Chinese Taipei 
Chile 

Austria 

Canada 

United States 
Hong Kong SAR 
England 
Hungary 

Latvia 

Belgium (French) 
Poland 
Germany 
Singapore 
Macao SAR 
Slovak Republic 
Czech Republic 
Slovenia 

Finland 

Belgium (Flemish) 
Netherlands 
Norway (5) 
Denmark 
Sweden 


Very Much Like 
Readin 


Percent 
of Students 


Average 
Achievement 


Somewhat Like 
Reading 


Percent 


of Students 


Do Not Like 


Percent 


of Students 


72 (1.1 530 (2.4 23 (1.0 526 (3.2 5 (0.4 
71 (1.2 536 (2.7 25 (1.0 535 (3.0 3 (0.4 
70 (1.8 441 (4.5 26 (1.4) 405 (7.5 4 (0.7) 
65 (1.0) 437 (3.3) 29 (0.8) 391 (4.2) 5 (0.4) 
64 (1.3 485 (3.6 32 (1.2 456 (5.7 4 (0.4 
64 (1.3 496 (2.9 31 (1.0 483 (3.5 5 (0.6 
57 (1.5) 446 (3.9) 36 (1.2) 417 (6.2) 7 (0.6) 
57 (1.5) 411 (4.1) 36 (1.3) 382 (5.2) 7 (0.7) 
56 (1.6 380 (4.1 39 (1.5 333 (5.0 5 (0.5 
56 (0.8 534 (1.5 34 (0.7 523 (3.5 10 (0.5 
56 (2.0) 361 (5.8) 35 (1.5) 308 (6.4) 9 (1.2) 
55 (1.2) 340 (3.7) 36 (0.9) 302 (5.6) 9 (0.6) 
55 (1.9) 558 (4.7) 33 (1.2) 557 (4.6) 12 (1.3) 
54 (1.2) 463 (3.1) 36 (1.1) 429 (3.0) 10 (0.6) 
54 (0.7) 471 (3.2) 37 (0.6) 433 (4.2) 9 (0.3) 
51 (0.8) 470 (2.4) 37 (0.7) 442 (2.4) 12 (0.4) 
50 (1.3) 492 (3.7) 40 (1.1) 467 (4.1) 11 (0.8) 
48 (0.9) 463 (2.3) 39 (0.8) 432 (2.8) 12 (0.5) 
46 (1.4) 582 (2.9) 44 (1.1) 581 (2.5) 10 (0.7) 
46 (1.1) 580 (3.0) 40 (1.0) 565 (2.9) 15 (0.8) 
44 (1.0) 535 (2.6) 42 (0.7) 520 (2.9) , (0.7) 
43 (1.3) 531 (3.5) 36 (0.8) 527 (3.7) 21 (1.1) 
43 (1.1) 558 (3.3) 41 (0.8) 543 (3.0) 16 (0.7) 
F (1.2) 551 (2.9) 46 (1.0) 550 (3.1) 13 (0.7) 
41 (1.1) 554 (2.5) 44 (1.0) 546 (2.7) 16 (0.8) 

40 (1.0 519 (3.0 46 (1.0 510 (3.0 14 (0.9 
39 (1.3 580 (2.9 42 (1.0 567 (2.7 19 (0.9 
37 (1.0 571 (2.5 44 (0.8) 558 (2.2 19 (0.7) 
37 (1.1 500 (3.3 39 (0.8 495 (3.1 24 (1.0 
37 (1.1 550 (3.1 45 (0.8 541 (2.6 18 (0.8 
37 (0.7) 555 (2.2) 45 (0.6) 543 (2.1) 18 (0.5) 
36 (1.2) 557 (3.8) 42 (0.9) 553 (3.4) 22 (0.9) 
36 (1.0 583 (3.1 44 (0.9 567 (3.3 21 (1.2 
35 (1.0 575 (2.5 45 (0.9 559 (2.2 20 (0.9 
35 (1.4) 570 (3.7) 46 (1.0) 552 (3.5) 19 (1.2) 
33 (1.2) 563 (2.8) 47 (1.2) 559 (2.0) 21 (1.0) 
33 (1.1) 504 (3.4) 44 (0.9) 500 (2.8) 23 (1.2) 
32 (1.1) 570 (3.2) 45 (1.0) 567 (2.8) 23 (1.0) 
32 (1.3) 563 (2.9) 43 (1.0) 548 (2.7) 25 (1.2) 
31 (0.8) 598 (3.6) 50 (0.6) 574 (3.3) 19 (0.6) 
31 (0.6) 564 (2.0) 50 (0.6) 543 (1.5) 19 (0.5) 
30 (1.1) 546 (4.0) 47 (0.8) 538 (3.6) 23 (1.0) 
30 (0.8) 549 (3.2) 50 (0.8) 548 (2.2) 20 (0.8) 
29 (1.1) 551 (3.2) 53 (1.2) 545 (2.7) 18 (1.1) 
28 (0.9) 584 (2.3) 49 (0.8) 568 (2.3) - (0.7) 
24 (1.0) 536 (3.0) 45 (0.8) 529 (2.0) 31 (1.1) 
24 (0.9) 560 (2.4) i (0.9) 550 (2.0) 31 (1.1) 
a (0.9) 575 (3.2) 51 (1.0) 565 (2.4) al (1.2) 
20 (0.8) 569 (2.9) 53 (1.0) 551 (2.4) 27 (1.2) 

8 (1.0) 572 (4.3) 50 (1.0) 563 (2.5) 31 (1.1) 

) S)) ) S)) i) 


Reading 


International Avg. 7 (0.2 41 (0.1 16 (0. 


This PIRLS questionnaire scale was established in 2016 based on the combined response distribution of all countries that participated in PIRLS 2016. To provide a 
point of reference for country comparisons, the scale centerpoint of 10 was located at the mean of the combined distribution. The units of the scale were chosen 


so that 2 scale score points corresponded to the standard deviation of the distribution. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Average 


Achievement 


Average 
Achievement 


513 (5.3 
536 (7.8 
344 (30.4) 
359 (7.7) 
443 (8.7 
460 (8.9 
399 (9.0) 
352 (11.1) 
306 (8.1 
512 (3.7 
245 (14.3) 
282 (9.1) 
511 (11.8) 
426 (5.5) 
409 (6.3) 
418 (4.7) 
459 (8.6) 
412 (5.3) 
572 (3.4) 
534 (4.6) 
) 
) 
) 
) 
) 


508 (4.2 
538 (3.9 
517 (3.0 
535 (4.2 
539 (3.7 
497 (3.4 
531 (3.8 
538 (2.9) 
486 (3.3 
524 (3.4 
525 (2.9) 
538 (3.8) 
549 (3.7 
530 (3.3 
530 (3.7) 
548 (2.9) 
484 (3.3) 
553 (2.7) 
510 (5.0) 
548 (3.7) 
522 (2.6) 
513 (5.4) 
524 (2.7) 
523 (3.2) 
540 (2.5) 
513 (2.6) 
527 (2.5) 
536 (2.8) 
528 (3.2) 
535 (3.2) 
486 (1.0) 


Fg 
g IEA International Study Center 
= 


Lynch School of Education 
BOSTON COLLEGE 


Average 


Scale Score 


11.4 (0.05 
11.4 (0.06 
11.2 (0.08 
11.2 (0.05 
10.9 (0.05 
10.9 (0.05 
10.7 (0.07 
10.6 (0.06 
10.8 (0.06 
10.7 (0.04 
10.6 (0.09 
10.6 (0.06) 
10.6 (0.10 
10.6 (0.05 
10.6 (0.03) 
10.4 (0.03) 
10.4 (0.06 
10.3 (0.03 
10.2 (0.06) 
10.0 (0.04) 
10.1 (0.04) 
9.9 (0.07 
10.0 (0.05 
10.0 (0.05 
9.9 (0.04, 
10.0 (0.04 
9.7 (0.05 
9.8 (0.05 
9.7 (0.06 
9.8 (0.05 
9.7 (0.03 
9.7 (0.05 
9.7 (0.05 
9.7 (0.04) 
9.7 (0.05 
9.6 (0.05 
9.6 (0.06 
9.6 (0.05 
9.4 (0.06) 
9.6 (0.03) 
9.5 (0.02 
9.5 (0.05 
9.5 (0.04) 
9.5 (0.04, 
9.4 (0.04 
9.1 (0.04, 
9.1 (0.05 
a 1 (0.04 

.1 (0.04 
4 9 (0.05, 


) 
) 
) 
) 


) 
) 
) 
) 


) 
) 
) 
) 
) 
) 
) 
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Exhibit 10.2: Students Like Reading (Continued) 


Very Much Like 


Reading 
Country 


Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement 


Benchmarking Participants 


Somewhat Like 


Andalusia, Spain 63 (1.2) 530 (2.1) 28 (0.9) 
Madrid, Spain 57 (1.4) 553 (2.1) 33 (1.1) 
Dubai, UAE 54 (1.0) 527 (2.2) 37 (0.9) 
Eng/Afr/Zulu - RSA (5) 53 (1.4) 413 (5.4) 38 (1.0) 
Abu Dhabi, UAE 50 (1.3) 439 (4.2) 40 (1.0) 
Buenos Aires, Argentina 44 (1.4) 476 (3.6) 36 (1.0) 
Moscow City, Russian Fed. 39 (1.3) 619 (2.4) 48 (1.1) 
Quebec, Canada 36 (1.2) 557 (3.8) 48 (1.2) 
Ontario, Canada 35 (1.0) 559 (4.3) 44 (1.0) 
Norway (4) 26 (1.0) 527 (3.2) 52 (1.1) 
Denmark (3) 21 (0.9) 522 (4.5) 52 (1.1) 


Reading 


520 (3.1) 
546 (2.6) 
507 (2.4) 
400 (7.7) 
396 (6.0) 
490 (3.5) 
611 (2.6) 
547 (3.0) 
542 (3.6) 
521 (2.3) 
503 (2.9) 


Do Not Like 


Reading 


9 (0.8) 
10 (0.8) 
8 (0.4) 
9 (0.6) 
10 (0.6) 
19 (1.1) 
12 (0.7) 
16 (0.8) 
21 (0.9) 
23 (1.0) 
27 (1.2) 


What do you think about reading? Tell how much you agree with each of these statements. 


Agree 
alot 


1) [like talking about what | read 
with other people 


| would be happy if someone gave 
mea book as a present 


3) I think reading is boring* 

) [would like to have more time for reading 
5) lenjoy reading 

) learn alot from reading 
7) Ilike to read things that make me think 


) [like it when a book helps me 
imagine other worlds 


* Reverse coded 


Very Much 


Like Reading 


How often do you do these things outside of school? 


ts 


Agree 
alittle 


Somewhat 


Reading 


10.3 


Every day 
or almost 
every day 


1) lread for fun 


2) lIread to find out about things | want to learn 


| 


10.3 
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Once or 
twicea 
week 


Somewhat 


Like Re: 


ading 


| 


8.3 


507 (5.7) 
536 (4.6) 
485 (5.3) 
409 (11.4) 
378 (9.4) 
489 (5.0) 
596 (3.8) 
531 (3.9) 
527 (4.6) 
500 (3.6) 
483 (4.2) 


Disagree Disagree 


alittle alot 


Do Not Like 
Reading 


Once or Never 


or 


twicea almost 


month never 


Do Not Like 
Reading 


ZF 
iF 


Average 


Scale Score 


11.0 (0.07) 
10.7 (0.06) 
10.6 (0.04) 
10.5 (0.06) 
10.4 (0.06) 
10.1 (0.07) 
10.0 (0.05) 
9.8 (0.05) 
9.6 (0.04) 
9.3 (0.04) 
9.1 (0.04) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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Exhibit 10.3: Students Confident in Reading 


Exhibit 10.3 presents the results for the PIRLS 2016 Students Confident in Reading scale. 
Internationally, on average, 45 percent of the fourth grade students reported being Very Confident 
in their reading, 35 percent reported being Somewhat Confident, and 21 percent reported they 
were Not Confident. 

There was a large difference in average reading achievement—90 points—between the students 
that expressed a high degree of confidence and those who were not confident. The results on the 
Students Confident in Reading scale show some of the largest achievement differences in PIRLS 
2016 between groups of students. The Very Confident students had higher average achievement 
than the Somewhat Confident students (545 vs. 503 for a difference of 42 points) and, similarly, the 
Somewhat Confident students had higher average achievement than the Not Confident students 
(503 vs. 455 for a difference of 48 points). 
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Exhibit 10.3: Students Confident in Reading 


Students’ Reports 

Students were scored according to their degree of agreement with six statements on the Students Confident in Reading scale. 
Students Very Confident in reading had a score on the scale of at least 10.3, which corresponds to their “agreeing a lot” with three 
of the six statements and “agreeing a little” with the other three, on average. Students who were Not Confident had a score no 
higher than 8.2, which corresponds to their “disagreeing a little” with three of the six statements and “agreeing a little” with the 
other three, on average. All other students were Somewhat Confident in reading. 


Very Confident Somewhat Confident Not Confident 


Average 


Countr 
y Scale Score 


Percent Average Percent Average Percent Average 
of Students Achievement of Students Achievement of Students Achievement 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Sweden a (0.8 575 (2.3 a (0.8 (33. 8 (0.5 (5. 10.8 (0.04) 
Finland 60 (0.9 586 (1.9 31 (0.9 549 (2.2 0 (0.5 503 (4.5 10.6 (0.04) 
Poland 59 (0.8 587 (2.3 29 (0.9 551 (3.1 12 (0.6 490 (4.1 10.7 (0.04) 
Bulgaria 58 (1.6 579 (3.8 28 (1.0 536 (4.9 14 (1.1 477 (7.9 10.4 (0.08) 
Austria 56 (1.0 562 (2.1 29 (0.9 526 (3.1 14 (0.7 493 (3.5 10.5 (0.04) 
Ireland 55 (1.0 593 (2.6 31 (0.8 550 (2.7 14 (0.8 505 (4.2 10.4 (0.04) 
Germany 55 (1.0 569 (2.4 30 (0.9 529 (3.6 15 (0.7 487 (4.7 10.5 (0.04) 
Israel 55 (1.1 567 (2.6 28 (0.7 511 (3.1 18 (0.8 454 (4.7 10.3 (0.05) 
Kazakhstan 55 (1.4 549 (2.5 27 (1.0 534 (3.0 18 (0.9 503 (3.8 10.5 (0.07) 
England 53 (0.9 591 (1.9 31 (0.8 541 (2.6 16 (0.5 488 (3.1 10.3 (0.03) 
Norway (5) 53 (0.9 584 (2.2 33 (0.8 545 (2.7 14 (0.8 505 (3.6 0.4 (0.04) 
Iran, Islamic Rep. of 51 (1.6 470 (5.2 30 (1.3 407 (6.0 19 (0.8 351 (6.1 10.3 (0.06) 
Canada 51 (0.6 574 (1.6 32 (0.5 530 (2.4 17 (0.6 482 (3.2 0.2 (0.03) 
Denmark 51 (0.8 577 (2:3. 36 (0.8 530 127 14 (0.6 486 (4.4 10.3 (0.04) 
Northern Ireland 50 (1.1 598 (2.2 33 (1.0 553 (3.0 17 (0.7 493 (4.1 0.2 (0.04) 
United States 50 (1.3 583 (2.6 32 (0.9 540 (3.4 19 (0.9 496 (4.1 10.2 (0.05) 
Netherlands 49 (1.1 565 (1.9 30 (0.8 536 (2.2 21 (0.9 511 (2.8 10.0 (0.05) 
Australia 49 (1.0 585 (2.4 34 (0.8 526 (2.9 16 (0.7 465 (3.7 10.2 (0.04) 
Singapore 48 (0.9 612 (2.6 36 (0.6 562 (3.1 16 (0.7 503 (4.8 10.1 (0.04) 
Hungary 48 (1.2 = (3.0 33 (0.9 542 (3.5 19 (0.9 495 (3.9 10.1 (0.05) 
Belgium (Flemish) 46 (1.0 44 (2.3 34 (0.8 519 (2.5 19 (0.7 493 (2.6 10.0 (0.04) 
Lithuania 46 (1.1 a (2.6 35 (1.0 538 (3.6 19 (0.8 496 (3.8 10.0 (0.04) 
Italy 46 (1.0 567 (2.2 38 (1.0 545 (2.7 16 (0.5 505 (4.3 10.1 (0.04) 
Trinidad and Tobago 46 (1.3 529 (2.7 31 (0.9 465 (3.6 23 (0.9 400 (4.1 10.0 (0.05) 
Slovenia 46 (1.0 571 (2.3 37 (0.9 538 (2.3 17 (0.7 481 (4.5 10.1 (0.04) 
Qatar 45 (0.8 494 (2.1 32 (0.7 434 (2.6 23 (0.7 371 (3.6 10.0 (0.03) 
Czech Republic 45 (0.8 569 (2.2 39 (0.7 537 (2.3 16 (0.6 490 (4.2 9.9 (0.03) 
France 44 (1.1 539 (2.6 39 (1.1 506 (2.6 17 (0.7 455 (3.7 10.0 (0.04) 
Slovak Republic 44 (1.0 567 (2.8 34 (0.8 533 (3.2 22 (0.9 475 (6.1 9.9 (0.04) 
Bahrain 44 (0.9 494 (2.3 33 (0.9 436 (3.3 23 (0.8 381 (3.7 9.9 (0.04) 
Russian Federation 43 (1.0 609 (2.3 38 (0.9 575 (2.4 19 (0.9 532 (3.4 9.9 (0.04) 
Belgium (French) 41 (0.9 528 (2.8 37 (0.8 493 (2.8 22 (0.7 450 (3.4 9.8 (0.04) 
Georgia 41 (1.3 523 (3.2 31 (1.0 489 (3.0 27 448 (4.3 9.7 (0.05) 
Oman 41 (1.2 468 (3.7 34 (0.9 413 (3.7 24 (0.8 352 (3.7 9.8 (0.05) 
Kuwait 41 (1.6 437 (4.6 39 (1.5 386 (4.8 20 (0.9 334 (7.7 9.8 (0.05) 
United Arab Emirates 41 (0.8 511 (3.6 36 (0.6 439 (3.1 23 (0.7 372 (3.6 9.8 (0.03) 
Malta 41 (0.8 495 (2.1 37 (0.8 447 (2.3 22 (0.6 387 (4.2 9.7 (0.03) 
Spain 40 (0.7 554 (1.8 40 (0.6 525 (2.1 20 (0.6 483 (2.7 9.7 (0.03) 
Portugal 38 (1.3 555 (2.7 40 (1.0 526 (2.7 22 (0.9 483 (3.0 9.7 (0.04) 
Chile 37 (0.9 532 (2.8 36 (0.8 494 (3.3 27 (0.8 451 (3.0 9.6 (0.04) 
Hong Kong SAR 36 (1.2 596 (2.5 38 (0.9 568 (3.4 26 (1.1 534 (3.2 9.6 (0.05) 
Azerbaijan 36 (1.0 508 (3.4 34 (1.1 475 (3.4 31 (1.3 439 (5.9 9.5 (0.04) 
Chinese Taipei 35 (1.2 589 (2.3 40 (0.9 557 (2.0 24 (0.9 519 (2.7 9.5 (0.05) 
New Zealand 35 (0.8 577 (2.5 41 (0.8 520 (2.7 24 (0.7 457 (3.8 9.6 (0.03) 
Egypt 33 (1.9 390 (6.1 36 (1.6 333 (5.7. 31 (1.8 268 (7.2 9.4 (0.09) 
Morocco 31 (1.1 416 (3.9 42 (1.0 358 (4.0 2a 296 (5.6 9.4 (0.05) 
Latvia 30 (1.0 588 (2.4 42 (1.1 562 (2.1 28 (1.1 520 (3.0 9.3 (0.04) 
Saudi Arabia 29 (1.5 473 (4.2 43 (1.2 439 (5.0 28 (1.4 385 (6.0 9.3 (0.05) 
Macao SAR 21 (0.7 582 (2.6 41 (0.8 551 (1.5, (0.7 519 (1.6 8.9 (0.03) 
South Africa 20 (1.0 398 (7.3 33 (0.7 326 (4.5 47 (1.0 288 (4.0 8.8 (0.04) 


International Avg. 45 (0.2) 545 (0.4) 35 (0.1) BIER (1) PAN) 455 (0.6) 


This PIRLS questionnaire scale was established in 2016 based on the combined response distribution of all countries that participated in PIRLS 2016. To provide a 
point of reference for country comparisons, the scale centerpoint of 10 was located at the mean of the combined distribution. The units of the scale were chosen 
so that 2 scale score points corresponded to the standard deviation of the distribution. 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Exhibit 10.3: Students Confident in Reading (Continued) 


Benchmarking Participants 


Ontario, Canada 
Norway (4) 

Dubai, UAE 

Denmark (3) 

Moscow City, Russian Fed. 
Quebec, Canada 
Madrid, Spain 
Andalusia, Spain 
Buenos Aires, Argentina 
Abu Dhabi, UAE 
Eng/Afr/Zulu - RSA (5) 


Very Confident Somewhat Confident Not Confident 
Percent Average Percent Average Percent Average 
of Students | Achievement | of Students | Achievement | of Students } Achievement 


52 (1.2) 
51 (1.0) 
50 (0.6) 
48 (0.9) 
48 (1.1) 
45 (1.4) 
44 (1.0) 
43 (1.2) 
41 (1.0) 
35 (1.3) 
29 (1.5) 


575 (3.0) 
546 (2.2) 
557 (2.0) 
537 (3.1) 
634 (2.2) 
575 (2.9) 
571 (2.1) 
552 (2.1) 
521 (3.3) 
486 (5.2) 
470 (7.3) 


37 (1.1) 
39 (0.9) 
38 (1.0) 
35 (1.0) 


529 (4.4 
503 (2.7 
500 (2.8 
486 (3.6 
605 (2.5 
541 (3.5 
542 (2.2 
521 (2.1 
480 (3.0) 
409 (5.1) 
407 (6.2) 


) 
) 
) 
) 
) 
) 
) 
) 


17 (1.3) 
15 (0.6) 
17 (0.6) 
15 (0.7) 
14 (0.7) 
19 (1.1) 
16 (0.8) 
19 (1.0) 
20 (0.9) 
27 (1.2) 
36 (1.4) 


How well do you read? Tell how much you agree with each of these statements. 


1) usually do well in reading 


2) Reading is easy for me 


3) | have trouble reading stories with difficult words* 


4) Reading is harder for me than for many 


of my classmates* 


5) Reading is harder for me than any other subject* 


6) lam just not good at reading* 


* Reverse coded 
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Agree Agree 


alot 


a aa 


Very 
Confident 


alittle 


Somewhat 
Confident 


10.3 


Disagree 
alittle 


485 (5.3) 
462 (3.2) 
434 (3.5) 
428 (4.7) 
560 (3.2) 
499 (4.4) 
507 (3.0) 
475 (3.8) 
427 (4.5) 
345 (4.9) 
360 (5.3) 


I Not Confident 


8.2 


Average 
Scale Score 


10.2 (0.06) 
10.3 (0.04) 
10.2 (0.03) 
10.1 (0.03) 
10.1 (0.04) 
10.0 (0.06) 
9.9 (0.04) 
9.8 (0.05) 
9.8 (0.04) 
9.6 (0.06) 
9.3 (0.06) 


Disagree 
alot 


ZF 
iF 


SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 
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Appendix A.1: Countries Participating in PIRLS 2016 and in Earlier 


PIRLS Assessments 


Australia 

Austria 
Azerbaijan 
Bahrain 

Belgium (Flemish) 
Belgium (French) 
Bulgaria 

Canada 

Chile 

Chinese Taipei 
Czech Republic 
Denmark 

Egypt 

England 

Finland 

France 

Georgia 

Germany 

Hong Kong SAR 
Hungary 

Iran, Islamic Rep. of 
Ireland 

Israel 

Italy 

Kazakhstan 
Kuwait 

Latvia 

Lithuania 

Macao SAR 

Malta 

Morocco 
Netherlands 

New Zealand 
Northern Ireland 
Norway (5) 

Oman 

Poland 

Portugal 

Qatar 

Russian Federation 
Saudi Arabia 
Singapore 

Slovak Republic 
Slovenia 

South Africa 
Spain 

Sweden 

Trinidad and Tobago 
United Arab Emirates 
United States 


@ Indicates participation in that testing cycle. 
O Indicates participation but data not comparable for measuring trends to 2016, primarily due to countries improving translations or 


16 2011 2006 2001 
e e@ 
@ e 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 
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increasing population coverage. 
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Appendix A.1: Countries Participating in PIRLS 2016 and in Earlier 
PIRLS Assessments (Continued) 


Ke} 

* 

Benchmarking Participants 3 
Buenos Aires, Argentina e S 
Ontario, Canada e e e e 2 
Quebec, Canada ® e e e 2 
Denmark (3) ® 3 
Norway (4) e e e @ é 
Moscow City, Russian Fed. e 5 
Eng/Afr/Zulu - RSA (5) e O e & 
Andalusia, Spain ® ® = 
Madrid, Spain ® £ 
Abu Dhabi, UAE e e g 
Dubai, UAE e ® Fa 

@ Indicates participation in that testing cycle. é 
O Indicates participation but data not comparable for measuring trends to 2016, primarily due to countries improving translations or g 
increasing population coverage. Fy 

iva) 
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Appendix B.1: Distribution of Assessment Items by Reading Purposes, 
Comprehension Processes, and Item Format 
Multiple-Choice Items Constructed Response Items Total Items 


Percentage 
PIRLS Assessment Items $ 


; ; y of Score Points 
Items Points Items Points Items Points 
| ReadingPurpose =| Purpose 


Literary Experience 46 46 44 67 90 113 51% 
Acquire and Use Information 40 40 45 70 85 110 49% 
| Comprehension Process | Process 
Focus on and Retrieve Explicitl 
ee eee 25 25 25 32 50 57 26% 

Stated Information 
Make Straightforward Inferences 35 35 18 24 53 59 26% 
Inter Integrate | 

te Beband tegrate Ideas and ‘i ig - . i - 25% 
Information 
Evaluate and Critique Content 15 5 10 fe 5 # 13% 


SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 


and Textual Elements 


re eee 


Items 86 86 89 137 175 223 100% 
Percentage of Score Points 39% 61% 


Multiple-Choice Items Constructed Response Items Total Items 
F Percentage 
PIRLS Literacy Items : 
of Score Points 
Items Points Items Points Items Points 
Reading Purpose 
Literary Experience 47 47 46 60 93 107 50% 
Acquire and Use Information 44 45 46 60 90 105 50% 
| Comprehension Process | Process 
F Retrieve Explicitl 
ocus on and puleye xplicitly 30 30 5 61 Pt 91 43% 
Stated Information 
Make Straightforward Inferences 35 35 7 19 52 54 25% 
| I I 
nterpretand ntegrate Ideas and 9 10 7 39 31 49 23% 
Information 
Eval nd Criti: nten 
valuate and Critique Content a a ; ; me e 9% 


and Textual Elements 


tet 


Items 91 92 92 120 183 212 100% 
Percentage of Score Points 43% 57% 


Because of rounding some results may appear inconsistent. 
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Appendix C.1: Coverage of PIRLS 2016 Target Population 


International Target Population 


Country School-level Within-sample ‘ 
Coverage Notes on Coverage : : Overall Exclusions 
Exclusions Exclusions 


Australia 100% 
Austria 100% 
Azerbaijan 100% 
Bahrain 100% 
Belgium (Flemish) 100% 
Belgium (French) 100% 
Bulgaria 100% 


Students from the provinces of Alberta, British 


Canada 97% Columbia, Manitoba, New Brunswick, Newfoundland, 


Ontario, Quebec, and Saskatchewan 


Chile 100% 
Chinese Taipei 100% 
Czech Republic 100% 
Denmark 100% 
Egypt 100% 
England 100% 
Finland 100% 
France 100% 
Georgia 96% Students taught in Georgian and Azerbaijani 
Germany 100% 
Hong Kong SAR 100% 
Hungary 100% 
Iran, Islamic Rep. of 100% 
Ireland 100% 
Israel 100% 
Italy 100% 
Kazakhstan 100% 
Kuwait 100% 
Latvia 100% 
Lithuania 100% 
Macao SAR 100% 
Malta 100% 
Morocco 100% 
Netherlands 100% 
New Zealand 100% 
Northern Ireland 100% 
Norway (5) 100% 
Oman 100% 
Poland 100% 
Portugal 100% 
Qatar 100% 
Russian Federation 100% 
Saudi Arabia 100% 
Singapore 100% 
Slovak Republic 100% 
Slovenia 100% 
South Africa 100% 
Spain 100% 
Sweden 100% 
Trinidad and Tobago 100% 
United Arab Emirates 100% 
United States 100% 


National Target Population does not include all of the International Target Population. 


National Defined Population covers 90% to 95% of National Target Population. 


National Defined Population covers less than 90% of National Target Population (but at least 77%). 
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Exclusions from National Target Population 


2.3% 
1.2% 
2.1% 
0.4% 
0.7% 
4.9% 
1.2% 


2.8% 


1.7% 
0.0% 
2.7% 
1.9% 
1.2% 
1.6% 
1.3% 
47% 
0.8% 
1.4% 
7.3% 
2.6% 
3.9% 
2.3% 


21.0% 


0.8% 
4.1% 
2.5% 
43% 
2.1% 
1.4% 
1.5% 
1.7% 
2.4% 
1.3% 
2.6% 
2.0% 
0.1% 
1.4% 
1.0% 
2.0% 
2.0% 
1.9% 


10.6% 


3.1% 
1.5% 
2.4% 
1.6% 
1.3% 
0.3% 
2.0% 
0.0% 


Z 
g 


= 


2.4% 
44% 
0.0% 
2.3% 
0.9% 
1.1% 
3.1% 


4.7% 


2.3% 
0.9% 
0.7% 
7.9% 
0.0% 
2.1% 
1.2% 
0.6% 
3.0% 
2.8% 
2.8% 
1.9% 
0.1% 
0.8% 
3.9% 
41% 
0.8% 
1.4% 
3.5% 
2.1% 
2.2% 
6.4% 
0.0% 
0.7% 
2.4% 
0.4% 
3.3% 
0.5% 
2.5% 
6.5% 
1.9% 
2.1% 
0.4% 
0.5% 
1.7% 
0.8% 
0.2% 
3.2% 
3.9% 
1.0% 
1.3% 
4.8% 


4.8% 
5.6% 
2.1% 
2.7% 
1.6% 
6.0% 
4.3% 


75% 


4.0% 
0.9% 
3.4% 
9.8% 
1.2% 
3.7% 
2.4% 
5.4% 
3.8% 
4.2% 


10.1% 


4.5% 
4.1% 
3.1% 


24.9% 


4.9% 
4.9% 
4.0% 
7.9% 
4.2% 
3.6% 
7.9% 
1.7% 
3.1% 
3.7% 
3.0% 
5.3% 
0.6% 
3.9% 
75% 
3.9% 
4.1% 
2.3% 


11.1% 


4.8% 
2.4% 
2.5% 
4.8% 
5.2% 
1.3% 
3.3% 
4.8% 
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Lynch School of Education 
BOSTON COLLEGE 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Benchmarking Participants 


Buenos Aires, Argentina 
Ontario, Canada 
Quebec, Canada 


Moscow City, Russian Fed. 
Eng/Afr/Zulu - RSA (5) 
Andalusia, Spain 

2 Madrid, Spain 
Abu Dhabi, UAE 


International Target Population 


Appendix C.1: Coverage of PIRLS 2016 Target Population (Continued) 


Exclusions from National Target Population 


School-level Within-sample ‘ 
Coverage Notes on Coverage ‘ ; Overall Exclusions 
Exclusions Exclusions 


100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
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1.5% 
2.3% 
3.5% 
1.9% 
2.0% 
0.8% 
0.9% 
1.0% 
3.1% 
2.2% 
1.6% 


1.2% 
1.8% 
1.6% 
7.5% 
3.0% 
2.6% 
0.2% 
3.2% 
3.4% 
1.7% 
1.5% 


g 
Zg 


2.8% 
4.1% 
5.1% 
9.3% 
5.1% 
3.3% 
1.1% 
4.2% 
6.5% 
3.9% 
3.2% 


TIMSS & PIRLS 


] EA International Study Center 
Lynch School of Education 
BOSTON COLLEGE 


SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 


Appendix C.2: School Sample Sizes 


Number of Schools in 


Number of Schools in Number of Eligible Schools Number of Replacement | Total Number of Schools 


2 
& 
CUnED Original Sample in Original Sample Grigatal ane met Schools that Participated that Participated z 
Participated L 
Australia 5 2 
Austria 0 z 
Azerbaijan 170 170 170 0 170 g 
Bahrain 184 183 182 0 182 F) 
Belgium (Flemish) 160 157 124 24 148 3 
Belgium (French) 158 158 152 6 158 = 
Bulgaria 154 153 153 0 153 Ss 
Canada 1020 998 872 54 926 € 
Chile 154 154 139 15 154 = 
Chinese Taipei 150 150 150 0 150 a 
Czech Republic 157 157 157 0 157 
Denmark 198 191 170 15 185 & 
Egypt 160 160 160 0 160 = 
England 71 170 168 Pl 170 i 
Finland 159 152 149 Z 151 s 
France 166 163 161 a 163 a 
Georgia 201 201 198 z 200 
Germany 210 209 204 4 208 
Hong Kong SAR 152 151 114 24 138 
Hungary 154 149 146 3 149 
Iran, Islamic Rep. of 274 271 271 0 271 
Ireland 150 148 148 0 148 
Israel 160 160 157 Z 159 
Italy 150 150 134 15 149 
Kazakhstan 174 172 171 1 172 
Kuwait 187 181 77 0 177 
Latvia 156 154 145 5 150 
Lithuania 196 195 195 0 195 
Macao SAR 57 57 57 0 57 
Malta 97 05 95 0 o5 
Morocco 361 360 360 0 360 
Netherlands 150 148 101 31 132 
New Zealand 198 198 167 21 188 
Northern Ireland 154 153 130 4 134 
Norway (5) 153 152 145 5 150 
Oman 308 307 305 1 306 
Poland 150 149 141 7 148 
Portugal 222 21 211 7 218 
Qatar 218 216 216 0 216 
Russian Federation 206 206 206 0 206 
Saudi Arabia 208 202 185 7 202 
Singapore 177 177 177 0 177 
Slovak Republic 221 220 208 12 220 
Slovenia 172 170 160 0 160 
South Africa 304 302 282 11 293 
Spain 630 629 625 4 629 
Sweden 158 154 153 1 154 
Trinidad and Tobago 152 151 151 0 151 
United Arab Emirates 482 475 467 1 468 
United States 176 172 131 7 158 


Benchmarking Participants 
SS 


Buenos Aires, Argentina 150 150 131 19 150 
Ontario, Canada 198 196 186 7) 188 
Quebec, Canada 176 174 89 38 127 
Denmark (3) 198 191 170 16 186 
Norway (4) 155 155 147 7 154 
Moscow City, Russian Fed. 150 150 150 0 150 
Eng/Afr/Zulu - RSA (5) 152 139 117 8 125 
Andalusia, Spain 150 150 148 7 150 
Madrid, Spain 168 168 168 0 168 
Abu Dhabi, UAE 153 151 151 0 151 
Dubai, UAE 178 175 174 0 174 
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Appendix C.3: Student Sample Sizes 


Within-school Number of 


Student Sampled ! Number of Number of Number of Number of 


Country Participation Students in Wi Feneeient Students Eligible Students Students 
(Weighted Participating Excluded Students Absent Assessed 


Percentage) Schools Class/School 


o 
& 
FA 
5 
Australia 95% 7,064 6,741 6,341 8 
Austria 98% 4,709 20 222 4,467 107 4360 2 
Azerbaijan 96% 6,361 113 0 6,248 254 5,994 3 
Bahrain 98% S771 56 148 5,567 87 5,480 - 
Belgium (Flemish) 98% 5,378 39 28 5,311 113 5,198 s 
Belgium (French) 97% 4,841 8 64 4,769 146 4,623 € 
Bulgaria 95% 4,677 75 108 4,494 213 4,281 = 
Canada 96% 20,072 265 736 19,071 826 18,245 e 
Chile 96% 4,648 2B 85 4,490 196 4,294 5 
Chinese Taipei 98% 4471 39 38 4,394 68 4,326 os 
Czech Republic 95% 5939 78 35 5,826 289 5,537 a 
Denmark 94% 4,091 68 278 3,745 237 3,508 ui 
Egypt 97% 7321 150 0 7,171 214 6,957 3 
England 96% 5,568 149 113 5,306 211 5,095 _ 
Finland 96% 5,178 52 42 5,084 188 4,896 
France 96% 5,050 56 33 4,961 194 4,767 
Georgia 97% 6,123 59 131 5,933 192 5,741 
Germany 96% 4,279 58 102 4119 160 3,959 
Hong Kong SAR 87% 4,024 21 96 3,907 558 3,349 
Hungary 97% 4,852 7 Dy 4,774 151 4,623 
Iran, Islamic Rep. of (Combined) 99% 8,999 106 10 8,883 117 8,766 
Literacy 99% 4,498 53 4 4,441 60 4381 
PIRLS 99% 4,501 53 6 4,442 57 4,385 
Ireland 96% 4,881 30 44 4,807 200 4,607 
Israel 95% 4,368 13 107 4,248 207 4,041 
Italy 96% 4309 22 166 4,121 181 3,940 
Kazakhstan 99% 5,035 51 0 4,984 59 4,925 
Kuwait 93% 5,082 66 14 5,002 393 4,609 
Latvia 94% 4,636 21 134 4,481 324 4,157 
Lithuania 95% 4,670 35 79 4556 239 4317 
Macao SAR 98% 4,254 10 93 4,151 92 4,059 
Malta 96% 4,022 6 223 3,793 146 3,647 
Morocco (Combined) 99% 11,370 194 0 11,176 234 10,942 
Literacy 99% 5,680 94 0 5,586 133 5,453 
PIRLS 99% 5,690 100 0 5,590 101 5,489 
Netherlands 96% 4,446 42 15 4389 183 4,206 
New Zealand 96% 6,128 77 119 5,932 286 5,646 
Northern Ireland 96% 3,920 27 20 3,873 180 3,693 
Norway (5) 96% 4,595 49 142 4,404 172 4,232 
Oman 99% 9,619 146 67 9,406 172 9,234 
Poland 91% 5,069 4B 125 4,901 488 4413 
Portugal 94% 5,305 58 293 4,954 312 4,642 
Qatar 97% 9,730 182 205 9,343 266 9,077 
Russian Federation 98% 4,740 4 63 4,673 96 4577 
Saudi Arabia 96% 5,044 37 23 4,984 243 4,741 
Singapore 97% 6,719 29 0 6,690 202 6,488 
Slovak Republic 97% 5,869 207 41 5,621 170 5,451 
Slovenia 96% 4721 10 35 4,676 177 4,499 
South Africa 96% 13,669 348 26 13,295 485 12,810 
Spain 97% 15,634 55 520 15,059 464 14,595 
Sweden 95% 4,988 38 189 4,761 236 4,525 
Trinidad and Tobago 96% 4,506 108 50 4348 171 4177 
United Arab Emirates 96% 17,381 89 232 17,060 589 16,471 
United States 94% 5,056 159 175 4722 297 4,425 


Students attending a sampled class at the time the sample was chosen but leaving the class before the assessment was administered were classified as “withdrawn.” 
Students with a disability or language barrier that prevented them from participating in the assessment were classified as “excluded.” 
Students not present when the assessment was administered, and not subsequently assessed in a make-up session, were classified as “absent.” 
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Benchmarking Participants 


Buenos Aires, Argentina 
Ontario, Canada 
Quebec, Canada 


Moscow City, Russian Fed. 
Eng/Afr/Zulu - RSA (5) 
Andalusia, Spain 


Abu Dhabi, UAE 
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Within-school 
Student 
Participation 


(Weighted 
Percentage) 


92% 
96% 
96% 
95% 
96% 
97% 
96% 
96% 
97% 
96% 
96% 


Appendix C.3: Student Sample Sizes (Continued) 


Number of 
Sampled 
Students in 
Participating 

Schools 


4,843 
4,572 
3,396 
4,120 
4,725 
4,494 
5,692 
4,470 
4,050 
4,408 
8,356 


Number of 
Students 
Excluded 


43 
71 
59 
261 
138 
49 
16 
132 
127 
Di, 
148 


Number of 
Eligible 
Students 


4,754 
4,451 
3,320 
3,799 
4,541 
4,431 
5,479 
4,316 
3,907 
4361 
8,158 


Number of 
Students 
Absent 


372 
181 
141 
199 
187 
142 
197 
147 
113 
173 
299 


Number of 
Students 
Assessed 


4,382 
4,270 
3,179 
3,600 
4,354 
4,289 
5,282 
4,169 
3,794 
4,188 
7,859 


TIMSS & PIRLS 
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Appendix C.4: Participation Rates (Weighted) 


Country 


Australia 
Austria 
Azerbaijan 
Bahrain 
Belgium (Flemish) 
Belgium (French) 
Bulgaria 
Canada 
Chile 
Chinese Taipei 
Czech Republic 
Denmark 
Egypt 
England 
Finland 
France 
Georgia 
Germany 
Hong Kong SAR 
Hungary 
Iran, Islamic Rep. of (Combined) 
Literacy 
PIRLS 
Ireland 
Israel 
Italy 
Kazakhstan 
Kuwait 
Latvia 
Lithuania 
Macao SAR 
Malta 
Morocco (Combined) 
Literacy 
PIRLS 
Netherlands 
New Zealand 
Northern Ireland 
Norway (5) 
Oman 
Poland 
Portugal 
Qatar 
Russian Federation 
Saudi Arabia 
Singapore 
Slovak Republic 
Slovenia 
South Africa 
Spain 
Sweden 
Trinidad and Tobago 
United Arab Emirates 
t United States 


+ 


=e 


School Participation 


Before 
Replacement 


97% 
100% 
100% 

99% 

79% 

96% 
100% 

81% 

92% 
100% 
100% 

87% 
100% 

99% 

98% 

99% 

98% 

97% 

74% 

98% 
100% 
100% 
100% 
100% 

98% 

89% 
100% 

98% 

95% 
100% 
100% 
100% 
100% 
100% 
100% 

69% 

85% 

84% 

95% 

99% 

95% 

97% 
100% 
100% 

92% 
100% 

94% 

94% 

92% 

99% 

99% 
100% 

98% 

75% 


ide 
Replacement 


100% 
100% 
100% 
99% 
94% 
100% 
100% 
90% 
100% 
100% 
100% 
96% 
100% 
100% 
99% 
100% 
99% 
100% 
91% 
100% 
100% 
100% 
100% 
100% 
99% 
99% 
100% 
98% 
97% 
100% 
100% 
100% 
100% 
100% 
100% 
90% 
97% 
88% 
99% 
100% 
99% 
99% 
100% 
100% 
100% 
100% 
100% 
94% 
97% 
100% 
100% 
100% 
99% 
92% 


Class 
Participation 


100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 


Student 
Participation 


95% 
98% 
96% 
98% 
98% 
97% 
95% 
96% 
96% 
98% 
95% 
94% 
97% 
96% 
96% 
96% 
97% 
96% 
87% 
97% 
99% 
99% 
99% 
96% 
95% 
96% 
99% 
93% 
94% 
95% 
98% 
96% 
99% 
99% 
99% 
96% 
96% 
96% 
96% 
99% 
91% 
94% 
97% 
98% 
96% 
97% 
97% 
96% 
96% 
97% 
95% 
96% 
96% 
94% 


Overall Participation 


92% 
98% 
96% 
98% 
77% 
93% 
95% 
77% 
88% 
98% 
95% 
82% 
97% 
95% 
95% 
95% 
95% 
93% 
64% 
95% 
99% 
99% 
99% 
96% 
93% 
85% 
99% 
91% 
89% 
95% 
98% 
96% 
99% 
99% 
99% 
66% 
81% 
81% 
91% 
98% 
86% 
91% 
97% 
98% 
88% 
97% 
92% 
90% 
88% 
95% 
94% 
96% 
95% 
1% 


Before Nie 
Replacement Replacement 


94% 
98% 
96% 
98% 
92% 
97% 
95% 
86% 
96% 
98% 
95% 
90% 
97% 
96% 
96% 
96% 
96% 
95% 
79% 
97% 
99% 
99% 
99% 
96% 
94% 
95% 
99% 
91% 
91% 
95% 
98% 
96% 
99% 
99% 
99% 
86% 
92% 
84% 
95% 
98% 
90% 
93% 
97% 
98% 
96% 
97% 
97% 
90% 
94% 
97% 
95% 
96% 
95% 
86% 


SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 


PIRLS guidelines for sampling participation: The minimum acceptable participation rates were 85 percent of both schools and students, or a combined rate (the 
product of school and student participation) of 75 percent. Participants not meeting these guidelines were annotated as follows: 


t+ Met guidelines for sample participation rates only after replacement schools were included. 


+ Nearly satisfied guidelines for sample participation rates after replacement schools were included. 


= Did not satisfy guidelines for sample participation rates. 
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Benchmarking Participants 


Buenos Aires, Argentina 
Ontario, Canada 
= Quebec, Canada 


Moscow City, Russian Fed. 
Eng/Afr/Zulu - RSA (5) 
Andalusia, Spain 


Abu Dhabi, UAE 


School Participation 


Before 
Replacement 


88% 
96% 
39% 
88% 
95% 
100% 
84% 
99% 
100% 
100% 
99% 
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After 


Replacement 


100% 
97% 
67% 
97% 
99% 

100% 
89% 

100% 

100% 

100% 
99% 


Appendix C.4: Participation Rates (Weighted) (Continued) 


Class 
Participation 


100% 
100% 

99% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 


Student 
Participation 


92% 
96% 
96% 
95% 
96% 
97% 
96% 
96% 
97% 
96% 
96% 


Overall Participation 


81% 
92% 
37% 
83% 
91% 
97% 
81% 
96% 
97% 
96% 
95% 


Before ide 
Replacement Replacement 


92% 
93% 
64% 
92% 
95% 
97% 
86% 
96% 
97% 
96% 
95% 


SOURCE: IEA's Progress in International Reading Literacy Study - PIRLS 2016 
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Appendix C.5: Trends in Student Populations 


Ko) 
Years of Formal Schooling* Average Age at Time of Testing Overall Exclusion Rates (After Replacement) a 
Country = 
SESeCHloIoecesoo 
Australia 4 94% Fa 
Austria 4 i ; 5 ; 03 ; oe : He 5.1% 98% ee g 
Azerbaijan 4 ; 10.1 10.2 21% 7.2% 96% 100% 2 
Belgium (Flemish) 4 4 10.1 10.0 1.6% 7.1% 92% 91% 8 
Belgium (French) 4 4 4 10.0 = 10.1 9.9 6.0% 5.6% 3.9% 97% 82% 95% S 
Bulgaria 4 4 4 4 108 10.7 109 109 43% 25% 64% 27% 95% 95% 94% 93% § 
Canada 4 4 9.9 9.9 75% 9.9% 86% 94% € 
Chinese Taipei 4 4 4 LOS 0;2 0:1 0.9% 14% 2.9% 98% 99% 99% g 
Czech Republic 4 4 4 10.3 = 10.4 10.5 34% 5.1% 5.0% 95% 94% 90% 4 
Denmark 4 4 4 108 10.9 109 9.8% 7.3% 6.2% 90% 95% 96% > 
England 5 5 5 5 10.3 103 103 10.2 3.7% 24% 24% 57% 96% 82% 92% 82% = 
Finland 4 4 108 10.8 24% 3.1% 96% 95% ra 
France 4 4 4 4 98 100 100 10.1 54% 52% 38% 53% 96% 97% 95% 94% u 
Georgia 4 4 4 O70) 100) 1051 3.8% 49% 7.3% 96% 96% 98% 3 
Germany 4 4 4 4 103 104 105 105 4.2% 1.9% 0.7% 1.8% 95% 95% 92% 86% ~ 
Hong Kong SAR 4 4 4 4 OO | Oi | OO 7 102 Pie pak | seks Pn | ive | eee | eivia | oie 
Hungary 4 4 4 4 106 107 107 107 45% 42% 3.7% 21% 97% 96% 97% 95% 
Iran, Islamic Rep. of 4 4 4 4 10.2 102 102 104 41% 45% 38% 05% 99% 99% 99% 98% 
Ireland 4 4 10.5 = 10.3 3.1% 2.5% 96% 95% 
Israel 4 4 10.0 = 10.1 24.9% 24.6% 94% 93% 
Italy 4 4 4 4 9.7 97 97 99 49% 3.7% 53% 2.9% 95% 95% 97% 98% 
Latvia 4 4 4 10.9 11.0 11.0 7.9% 47% 4.6% 91% 92% 89% 
Lithuania 4 4 4 4 108 107 107 10.9 42% 56% 5.1% 38% 95% 94% 92% 83% 
Malta 5 5 97 9.8 79% 4.1% 96% 94% 
Morocco 4 4 10.2 = 10.5 1.7% 2.0% 99% 95% 
Netherlands 4 4 4 4 10.1 102 103 103 3.1% 3.7% 36% 3.7% 86% 89% 90% 87% 
New Zealand 45-55 45-55 45-55 45-55 101 101 100 101 3.7% 3.3% 53% 3.2% 92% 93% 95% 96% 
Northern Ireland 4 4 10.4 10.4 3.0% 3.5% 84% 79% 
Norway (4) 4 4 4 4 98 97 98 10.0 5.1% 42% 38% 28% 95% 71% 71% 82% 
Oman 4 4 97 98) 0.6% 1.5% 98% 96% 
Portugal 4 4 98 10.0 75% 2.5% 93% 93% 
Qatar 4 4 10.0 10.0 3.9% 6.2% 97% 99% 
Russian Federation 4 4 30r4 30r4 108) = 10.8 = 10.8 = 10.3 4.1% = 5.3% )~— 5.9% = 6.6% ~=— 98% 98% = «O7% = «7% 
Saudi Arabia 4 4 OO | 100) 23% 1.6% 96% 98% 
Singapore 4 4 4 4 104 104 104 10.1 11.1% 63% 0.9% 0.1% 97% 96% 95% 98% 
Slovak Republic 4 4 4 4 104 104 104 103 48% 46% 36% 20% 97% 96% 94% 96% 
Slovenia 4 4 30r4 3 9.9 9.9 9.9 98 24% 26% 0.8% 0.3% 90% 94% 93% 94% 
South Africa 4 4 10.6 10.5 2.5% 3.0% 94% 95% 
Spain 4 4 4 9.9 9.9 9.9 48% 54% 5.3% 97% 96% 97% 
Sweden 4 4 4 4 ly | iy} OE) | DEY | Bye | AIS | sith | oy | Shin | Silko | Elsie | PMs 
Trinidad and Tobago 5 5 5 10.2 103 10.1 13% 0.9% 0.7% 96% 95% 94% 
United Arab Emirates 4 4 9.8 9.8 3.3% 3.3% 95% 97% 
United States 4 4 4 4 10.1 102 101 102 48% 7.2% 5.9% 53% 86% 81% 82% 83% 
Benchmarking Participants 
Ontario, Canada 4 4 4 9.8 9.9 9.8 99 41% 7.9% 83% 6.6% 93% 95% 87% 92% 
Quebec, Canada 4 4 4 4 10.1 10.1 101 102 5.1% 3.7% 36% 3.3% 64% 92% 81% 89% 
Eng/Afr/Zulu - RSA (5) 5 5 11.6 11.7 1.1% 4.3% 86% 88% 
Andalusia, Spain 4 4 9.8 O19) 42% 5.1% 96% 96% 
Abu Dhabi, UAE 4 4 97 9.7 3.9% 2.7% 96% 96% 
Dubai, UAE 4 4 8) 9.9 Wey | sili 95% 94% 


* Represents years of schooling counting from the first year of ISCED Level 1. 
An empty cell indicates a country did not participate in that year's assessment or did not have comparable data. 
Trend results for Azerbaijan do not include students taught in Russian. Trend results for Lithuania do not include students taught in Polish or Russian. 
Austria's increased exclusions in 2016 resulted from more non-native language speakers, probably due to the refugee crisis in Europe. 
Canada's decreased exclusions in 2016 resulted from provinces formerly reported as exclusions to be considered not covered by the target population. 
Georgian schools in South Ossetia and Abkhazia were excluded in 2011 and 2016 due to lack of access and absence of official statistics. Abkhazia refugee schools in 
other territories of Georgia were included in the sample frame. 


Hong Kong SAR's increased exclusions in 2011 and 2016 resulted from excluding international schools and schools organized by the English Schools Foundation. 
These schools do not follow Hong Kong's central curriculum and medium of instruction. 


Singapore's increased exclusions in 2016 resulted from increased enrollment in private schools, which predominantly serve international students 
and are different from public schools in many respects (e.g., different language of instruction and calendar year). 
Republic of South Africa (RSA) tested 5th grade students receiving instruction in English (Eng), Afrikaans (Afr) and Zulu. Exclusion and participation 
rates from 2006 are for the entire country of South Africa. 
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Appendix D.1: Percentage of Students with Achievement Too Low for Estimation* 


* 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Country 


Australia 
Austria 
Azerbaijan 

Bahrain 

Belgium (Flemish) 
Belgium (French) 
Bulgaria 

Canada 

Chile 

Chinese Taipei 
Czech Republic 
Denmark 

Egypt 

England 

Finland 

France 

Georgia 

Germany 

Hong Kong SAR 
Hungary 

Iran, Islamic Rep. of 
Ireland 

Israel 

Italy 

Kazakhstan 

Kuwait 

Latvia 

Lithuania 

Macao SAR 

Malta 

Morocco 
Netherlands 

New Zealand 
Northern Ireland 
Norway (5) 

Oman 

Poland 

Portugal 

Qatar 

Russian Federation 
Saudi Arabia 
Singapore 

Slovak Republic 
Slovenia 

South Africa 

Spain 

Sweden 

Trinidad and Tobago 
United Arab Emirates 
United States 


Combined PIRLS 
and PIRLS Literacy 
Percent of Students 


with Achievement 
Too Low For 
Estimation 
1 (0.2) 
0 (0.1) 
3 (0.5) 
5 (0.4) 
0 (0.1) 
1 (0.2) 
1 (0.2) 
1 (0.2) 
2 (0.3) 
0 (0.1) 
1 (0.2) 
1 (0.2) 
10 (0.9) 
1 (0.1) 
0 (0.1) 
1 (0.1) 
2 (0.2) 
1 (0.4) 
0 (0.1) 
0 (0.1) 
5 (0.6) 
1 (0.3) 
2 (0.2) 
0 (0.1) 
0 (0.1) 
3 (0.4) 
0 (0.1) 
0 (0.1) 
0 (0.1) 
5 (0.3) 
10 (0.7) 
0 (0.1) 
2 (0.3) 
1 (0.1) 
0 (0.1) 
8 (0.4) 
0 (0.1) 
0 (0.1) 
7 (0.3) 
0 (0.0) 
7 (0.5) 
1 (0.1) 
1 (0.3) 
1 (0.1) 
8 (0.6) 
0 (0.1) 
0 (0.1) 
4 (0.3) 
6 (0.3) 
1 (0.1) 


PIRLS Percent of 
Students with 
Achievement Too 
Low for Estimation 


1 (0.2) 
0 (0.1) 
3 (0.5) 
5 (0.4) 
0 (0.1) 
1 (0.2) 
1 (0.2) 
1 (0.2) 
2 (0.3) 
0 (0.1) 
1 (0.2) 
1 (0.2) 
1 (0.1) 
0 (0.1) 
1 (0.1) 
2 (0.2) 
1 (0.4) 
0 (0.1) 
0 (0.1) 
8 (0.8) 
1 (0.3) 
2 (0.2) 
0 (0.1) 
0 (0.1) 
0 (0.1) 
0 (0.1) 
0 (0.1) 
5 (0.3) 

16 (1.1) 
0 (0.1) 
2 (0.3) 
1 (0.1) 
0 (0.1) 
8 (0.4) 

0 (0.1) 

0.1) 

(0.3) 

0.0) 

0.5) 

(0.1) 

0.3) 

1 (0.1) 

0 (0.1) 

0 (0.1) 

4 (0.3) 

6 (0.3) 

1 (0.1) 


—_- eS NO™N OO 


PIRLS Literacy 
Percent of Students 
with Achievement 
Too Low for 
Estimation 


PIRLS Average 
Percent Correct 


64 (0.6) 
63 (0.6) 
47 (0.8) 
42 (0.4) 
59 (0.5) 
52 (0.5) 
66 (1.0) 
64 (0.4) 
51 (0.6) 
68 (0.5) 
64 (0.5) 
65 (0.5) 
67 (0.4) 
69 (0.4) 
55 (0.5) 
50 (0.6) 
62 (0.7) 
70 (0.6) 
66 (0.7) 
38 (0.6) 
69 (0.6) 
61 (0.6) 
65 (0.5) 
62 (0.6) 
67 (0.4) 
65 (0.6) 
64 (0.2) 
42 (0.3) 
25 (0.5) 
64 (0.4) 
59 (0.5) 
69 (0.5) 
68 (0.5) 
37 (0.6) 
69 (0.5) 
59 (0.6) 
42 (0.3) 
2 (0.5) 
38 (0.8) 
71 (0.7) 
62 (0.7) 
63 (0.5) 
60 (0.4) 
66 (0.6) 
48 (0.7) 
43 (0.7) 
65 (0.7) 


PIRLS Literacy 


Average Percent 


Correct 


45 (1.1) 


64 (1.0) 


51 (0.8) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


Students were considered to have achievement too low for estimation if their performance on the assessment was no better than could 
be achieved by simply guessing on the multiple choice assessment items. However, such students were assigned scale scores (plausible 
values) by the achievement scaling procedure, despite concerns about their reliability. 


A dash (-) indicates comparable data not available. 
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Benchmarking Participants 


Buenos Aires, Argentina 
Ontario, Canada 
Quebec, Canada 


Moscow City, Russian Fed. 
Eng/Afr/Zulu - RSA (5) 
Andalusia, Spain 


Abu Dhabi, UAE 


Combined PIRLS 
and PIRLS Literacy 
Percent of Students 


with Achievement 


Too Low For 
Estimation 


3 (0.4) 
1 (0.2) 
0 (0.1) 
0 (0.1) 
1 (0.2) 
0 (0.0) 
9 (0.8) 
0 (0.2) 
0 (0.1) 
10 (0.7) 
2 (0.2) 


Downloaded from http://pirls2016.org/download-center/ 


PIRLS Percent of 
Students with 
Achievement Too 
Low for Estimation 


3 (0.4) 
1 (0.2) 
0 (0.1) 
1 (0.2) 
0 (0.0) 
9 (0.8) 
0 (0.2) 
0 (0.1) 


10 (0.7) 


2 (0.2) 


Percent of Students 
with Achievement 


Appendix D.1: Percentage of Students with Achievement Too Low for Estimation* 
(Continued) 


PIRLS Average 
Percent Correct 


48 (0.7) 
64 (0.8) 
65 (0.7) 
57 (0.4) 
80 (0.4) 
34 (1.2) 
59 (0.5) 
65 (0.5) 
36 (0.9) 
57 (0.4) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


TIMSS & PIRLS 
IE A International Study Center 


Lynch School of Education 
BOSTON COLLEGE 


Country 


Overall Reading 


Downloaded from http://pirls2016.org/download-center/ 


Reading Purposes 


Literary 


Informational 


Retrieving and 
Straightforward 


Appendix E.1: Average Percent Correct in the Reading Purposes and 
Comprehension Processes 


Comprehension Processes 


Inferencing 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


Interpreting, 
Integrating, and 
Evaluating 


Australia 64 (0.6) 67 (0.6) 61 (0.6) 72 (0.5) 56 (0.6) a 
Austria 63 (0.6) 66 (0.6) 59 (0.6) 74 (0.6) 50 (0.6) a 
Azerbaijan 47 (0.8) 47 (0.8) 46 (0.9) 58 (0.9) 34 (0.8) & 
Bahrain 42 (0.4) 42 (0.6) 41 (0.3) 51 (0.4) 31 (0.5) & 
Belgium (Flemish) 59 (0.5) 61 (0.5) 56 (0.5) 69 (0.4) 47 (0.5) g 
Belgium (French) 52 (0.5) 56 (0.5) 48 (0.6) 63 (0.6) 39 (0.6) 8 
Bulgaria 66 (1.0) 68 (1.0) 64 (1.0) 74 (0.9) 56 (1.1) 2 
Canada 64 (0.4) 68 (0.4) 61 (0.4) 73 (0.4) 55 (0.5) = 
Chile 51 (0.6) 56 (0.6) 47 (0.6) 62 (0.5) 40 (0.7) 3 
Chinese Taipei 68 (0.5) 68 (0.5) 68 (0.5) 77 (0.4) 58 (0.6) 3 
Czech Republic 64 (0.5) 67 (0.5) 60 (0.5) 75 (0.5) 52 (0.6) < 
Denmark 65 (0.5) 68 (0.5) 61 (0.5) 74 (0.5) 54 (0.6) a 
England 67 (0.4) 70 (0.5) 64 (0.5) 75 (0.4) 59 (0.5) & 
Finland 69 (0.4) 71 (0.5) 67 (0.5) 79 (0.4) 59 (0.5) 2 
France 55 (0.5) 58 (0.6) 52 (0.5) 68 (0.5) 41 (0.6) 
Georgia 50 (0.6) 53 (0.6) 47 (0.7) 60 (0.6) 40 (0.7) 
Germany 62 (0.7) 66 (0.7) 59 (0.7) 73 (0.7) 50 (0.7) 
Hong Kong SAR 70 (0.6) 71 (0.7) 69 (0.7) 79 (0.5) 61 (0.8) 
Hungary 66 (0.7) 69 (0.7) 63 (0.8) 74 (0.6) 57 (0.8) 
Iran, Islamic Rep. of 38 (0.6) 42 (0.7) 35 (0.6) 48 (0.7) 28 (0.6) 
Ireland 69 (0.6) 72 (0.6) 66 (0.6) 77 (0.5) 60 (0.7) 
Israel 61 (0.6) 64 (0.6) 58 (0.6) 70 (0.5) 51 (0.7) 
Italy 65 (0.5) 67 (0.5) 62 (0.5) 74 (0.5) 55 (0.5) 
Kazakhstan 62 (0.6) 63 (0.6) 62 (0.7) 70 (0.6) 53 (0.7) 
Latvia 67 (0.4) 69 (0.4) 66 (0.4) 76 (0.4) 59 (0.5) 
Lithuania 65 (0.6) 67 (0.6) 63 (0.7) 74 (0.5) 54 (0.7) 
Macao SAR 64 (0.2) 65 (0.3) 64 (0.3) 75 (0.2) 53 (0.3) 
Malta 42 (0.3) 45 (0.3) 39 (0.3) 52 (0.3) 31 (0.3) 
Morocco 25 (0.5) 26 (0.5) 24 (0.6) 35 (0.7) 15 (0.4) 
Netherlands 64 (0.4) 67 (0.4) 61 (0.4) 74 (0.4) 53 (0.5) 
New Zealand 59 (0.5) 62 (0.5) 56 (0.6) 68 (0.5) 49 (0.5) 
Northern Ireland 69 (0.5) 72 (0.5) 65 (0.5) 76 (0.4) 60 (0.6) 
Norway (5) 68 (0.5) 70 (0.5) 65 (0.6) 77 (0.5) 58 (0.7) 
Oman 37 (0.6) 37 (0.6) 36 (0.7) 46 (0.7 26 (0.7) 
Poland 69 (0.5) 72 (0.5) 66 (0.6) 76 (0.4) 61 (0.6) 
Portugal 59 (0.6) 62 (0.6) 56 (0.6) 70 (0.5) 48 (0.7) 
Qatar 42 (0.3) 42 (0.3) 41 (0.3) 51 (0.3) 32 (0.3) 
Russian Federation 73 (0.5) 74 (0.5) 71 (0.5) 81 (0.4 64 (0.6) 
Saudi Arabia 38 (0.8) 40 (0.8) 36 (0.9) 47 (0.8 29 (0.8) 
Singapore 71 (0.7) 73 (0.7) 70 (0.8) 79 (0.6 63 (0.8) 
Slovak Republic 62 (0.7) 66 (0.7) 58 (0.7) 72 (0.6 51 (0.7) 
Slovenia 63 (0.5) 66 (0.5) 61 (0.6) 73 (0.5) 52 (0.5) 
Spain 60 (0.4) 63 (0.5) 56 (0.4) 69 (0.4) 49 (0.5) 
Sweden 66 (0.6) 69 (0.6) 64 (0.6) 76 (0.5) 56 (0.7) 
Trinidad and Tobago 48 (0.7) 50 (0.8) 47 (0.7) 59 (0.7) 37 (0.7) 
United Arab Emirates 43 (0.7) 43 (0.7) 43 (0.7) 52 (0.7) 33 (0.7) 
United States 65 (0.7) 69 (0.7) 61 (0.8) 73 (0.7) 57 (0.8) 
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Country 


Benchmarking Participants 


Buenos Aires, Argentina 
Ontario, Canada 
Quebec, Canada 
Norway (4) 


Moscow City, Russian Fed. 


Eng/Afr/Zulu - RSA (5) 
Andalusia, Spain 
Madrid, Spain 

Abu Dhabi, UAE 
Dubai, UAE 


Overall Reading 


48 (0.7) 
64 (0.8) 
65 (0.7) 
57 (0.4) 
80 (0.4) 
34 (1.2) 
59 (0.5) 
65 (0.5) 
36 (0.9) 
57 (0.4) 


Downloaded from http://pirls2016.org/download-center/ 


Reading Purposes 


Literary 


51 (0.7) 
67 (0.8) 
68 (0.6) 
60 (0.5) 
82 (0.4) 
35 (1.2) 
62 (0.5) 
68 (0.5) 
36 (0.9) 
58 (0.4) 


Informational 


45 (0.7) 
60 (0.9) 
62 (0.7) 
54 (0.5) 
78 (0.5) 
32 (1.2) 
56 (0.6) 
62 (0.5) 
36 (0.9) 
57 (0.4) 


Appendix E.1: Average Percent Correct in the Reading Purposes and 
Comprehension Processes (Continued) 


59 (0.7) 
72 (0.7) 
75 (0.6) 
68 (0.4) 
86 (0.3) 
43 (1.3) 
68 (0.5) 
74 (0.4) 
45 (0.9) 
66 (0.4) 


Comprehension Processes 


Retrieving and 
Straightforward 
Inferencing 


Interpreting, 
Integrating, and 
Evaluating 


36 (0.7 
55 (0.8 
54 (0.8 
45 (0.5 
73 (0.5) 
24 (1.1) 
48 (0.5) 
55 (0.6) 
26 (0.9) 
48 (0.4) 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


TIMSS & PIRLS 
IE A International Study Center 


Lynch School of Education 
BOSTON COLLEGE 


Appendix E.2: Average Percent Correct in the Reading Purposes and 
Comprehension Processes - PIRLS Literacy 


Reading Purposes Comprehension Processes 
Country Overall Reading Retrieving and Interpreting, 
Literary Informational Straightforward | Integrating, and 
Inferencing Evaluating 


Egypt 42 (1.0) 42 (1.0) 42 (1.0) 47 (1.1) 30 (0.9) 
Iran, Islamic Rep. of 59 (0.9) 59 (0.9) 60 (1.0) 66 (1.0) 45 (0.8) 
Kuwait 53 (0.8) 52 (0.8) 54 (0.9) 60 (0.8) 38 (0.9) 
Morocco 47 (0.8) 47 (0.8) 48 (0.8) 55 (0.8) 32 (0.7) 
South Africa 38 7 _ 39 7 ; 37 (0.8) 44 7 : 25 (0. ; 


Benchmarking Participants 
Denmark (3) 74 (0.4) 74 (0.4) 74 (0.4) 80 (0.4) 61 (0.5) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 


SOURCE: IEA's Progress in International Reading Literacy Study — PIRLS 2016 


TIMSS & PIRLS 


Fg 
g IEA International Study Center 
_— 
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Appendix F.1: Percentiles of Reading Achievement 


Ke) 
5th 10th 25th 50th 75th a 
Country P . x ‘ . ; . kd 
Percentile | Percentile | Percentile | Percentile | Percentile | Percentile | Percentile 
1 
Australia 394 (6.3) 432 (5.5) (3.9) 552 (3.1 603 (2.7) 644 (2.7) 7) = 
Austria 427 (4.4) 454 (4.8 500 (2.9) 545 (2.4 586 (2.2) 620 (2.4 6) a 
Azerbaijan 312 (10.1) 353 (9.1 422 (5.4) 483 (4.2 533 (2.9) 572 (2.6 7) S 
Bahrain 274 (6.5) 313 (3.8) 381 (3.6) 453 (2.5 515 (2.7) 567 (3.1) 9) a 
Belgium (Flemish) 420 (3.8) 446 (3.6) 486 (2.6) 527 (2.2 567 (2.3) 601 (2.0 6) 5 
Belgium (French) 378 (4.9) 408 (4.7 454 (3.1) 500 (2.7 544 (2.5) 584 (3.6 8) € 
Bulgaria 398 (11.0) 440 (7.5 501 (6.5) 559 (4.8 611 (3.5) 653 (3.5 ) Ee 
Canada 407 (4.0) 444 (3.9 497 (2.7) 549 (2.2 596 (2.0) 634 (2.0 ) 8 
Chile 356 (5.1) 388 (4.0 442 (3.5) 499 (3.0 550 (3.1) 591 (3.1 614 (3.2) g 
Chinese Taipei 445 (5.1) 475 (3.7 521 (2.9) 563 (1.7 603 (2.3) 637 (2.6 657 (2.7) s 
Czech Republic 424 (7.0) 456 (4.6 503 (2.8) 548 (1.8 590 (2.3) 625 (2.4) 645 (3.6) 
Denmark 425 (6.3) 457 (4.2 507 (3.0) 553 (2.6 594 (2.5) 628 (2.9 650 (3.9) 2 
Egypt 112 (9.2 161 (8.6) 246 (7.9) 340 (6.4) 420 (6.0 483 (6.7) 520 (7.1) £2 
England 421 (6.4 455 (3.3) 508 (3.1 564 (2.1) 613 (2.2 655 (2.9) 680 (3.3 . 
Finland 449 (6.9 481 (4.6) 526 (2.7 571 (2.3) 612 (2.0 647 (2.5) 667 (2.4 & 
France 389 (5.2 420 (3.7) 468 (2.8) 516 (2.6) 559 (2.2 595 (3.7) 617 (4.0) & 
Georgia 347 (7.0 383 (5.3) 440 (3.4) 495 (3.3) 543 (3.0 584 (3.8) 606 (3.9) 
Germany 395 (11.5) 435 (6.7) 493 (4.2 544 (2.8) 591 (2.8 629 (3.1) 652 (4.3 
Hong Kong SAR 457 (9.3 487 (4.4) 531 (2.6 573 (3.2) 612 (3.0 645 (3.0) 663 (4.2 
Hungary 421 (5.5 452 (5.8) 506 (4.6) 560 (3.6) 606 (3.6 645 (3.1) 668 (4.0 
Iran, Islamic Rep. of 226 (12.7) 278 (9.7) 361 (5.9 44) (4.4) 505 (2.8 553 (2.7) 581 (4.2 
Ireland 435 (9.5 472 (5.2) 522 (3.5 572 (2.7) 617 (3.0 656 (3.2) 678 (3.5 
Israel 365 (6.6 407 (3.7) 475 (4.5 542 (2.2) 593 (2.9 635 (3.4) 660 (4.7 
Italy 432 (6.2 461 (5.4) 508 (3.2 553 (2.6) 592 (2.4 627 (2.8) 647 (3.1 
Kazakhstan 429 (4.3 455 (4.2) 496 (3.5 538 (3.0) 578 (3.2 615 (3.6) 635 (4.0 
Kuwait 207 (9.9 250 (7.4) 326 (5.5 401 (4.7) 466 (4.4) 522 (5.8) 556 (7.4 
Latvia 451 (5.0 475 (3.6) 518 (2.4) 561 (2.3) 601 (2.3) 636 (3.8 656 (2.3) 
Lithuania 424 (6.6) 459 (5.5) 506 (3.9) 553 (3.1 595 (4.0) 632 (2.9) 654 (4.0) 
Macao SAR 429 (5.0) 459 (2.6) 506 (1.4) 551 (1.4 590 (1.4) 625 (1.7) 646 (3.6) 
Malta 289 (6.8) 328 (5.5 394 (2.5) 462 (2.3 517 (2.2) 560 (2.3 583 (2.4) 
Morocco 180 (6.3) 217 (4.9 282 (5.3) 359 (5.5 436 (3.6) 496 (3.6 529 (3.9) 
Netherlands 44) (5.4) 466 (3.4) 508 (2.5) 548 (2.4 586 (2.1) 619 (2.2 639 (2.9) 
New Zealand 356 (6.8) 400 (5.3 469 (3.4) 532 (2.3 586 (3.1) 630 (3.0 656 (3.0) 
Northern Ireland 420 (7.1) 460 (5.4) 516 (2.8) 571 (2.4 619 (3.1) 662 (2.2 687 (3.0) 
Norway (5) 446 (6.1) 474 (4.4) 518 (2.9) 562 (2.5 603 (2.9) 640 (3.1 661 (3.2) 
Oman 234 (4.5) 275 (3.4) 348 (4.2) 426 (3.9 494 (4.0) 549 (4.2 580 (5.7) 
Poland 436 (5.2) 470 (4.6 521 (3.3) 569 (2.7 615 (2.4) 652 (2.3 675 (4.4) 
Portugal 417 (4.3) 44) (4.0 485 (3.3) 530 (2.1 572 (2.9) 611 (3.3 633 (5.5) 
Qatar 249 (5.1) 291 (3.9 367 (3.4) 452 (2.5 523 (1.7) 577 (2.4) 608 (3.6) 
Russian Federation 465 (5.2 495 (4.1) 540 (2.8) 584 (2.5) 626 (2.7 663 (2.6) 684 (3.3) 
Saudi Arabia 263 (8.6 298 (6.0) 363 (6.0) 436 (4.5) 500 (4.3 553 (6.6) 582 (5.7) 
Singapore 432 (7.8 469 (6.2) 528 (4.4 583 (2.9) 633 (3.5 673 (4.2) 695 (3.9 
Slovak Republic 381 (15.5) 430 (8.6) 493 (3.8 545 (2.6) 589 (2.7 626 (2.9) 647 (2.2 
Slovenia 413 (6.3 444 (3.7) 498 (3.8) 549 (2.3) 592 (2.2 629 (2.8) 651 (3.6) 
South Africa 147 (4.9 182 (4.7) 246 (3.9) 320 (4.2) 390 (5.0 456 (7.9) 498 (9.5) 
Spain 413 (5.1 44) (3.9) 486 (2.2 532 (1.8) 573 (1.4 607 (2.1) 628 (2.2 
Sweden 434 (5.7 465 (4.0) 515 (3.1 561 (2.8) 601 (3.2 635 (3.5) 656 (3.5 
Trinidad and Tobago 310 (8.3 351 (5.6) 420 (4.7 487 (5.4) 547 (3.5 594 (2.5) 619 (4.8 
United Arab Emirates 260 (4.8 299 (4.1) 373 (4.2 455 (4.2) 533 (3.6 590 (2.5) 622 (2.6 
United States 410 (5.9 446 (6.3) 501 (4.1 555 (3.2) 604 (3.3 645 (4.0) 666 (4.4 


Note: Percentiles are defined in terms of percentages of students at or below a point on the scale. 
() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Appendix F.1: Percentiles of Reading Achievement (Continued) 


Country 


Benchmarking Participants 


Buenos Aires, Argentina 
Ontario, Canada 
Quebec, Canada 
Denmark (3) 

Norway (4) 

Moscow City, Russian Fed. 
Eng/Afr/Zulu - RSA (5) 
Andalusia, Spain 
Madrid, Spain 

Abu Dhabi, UAE 

Dubai, UAE 


5th 


Percentile 


335 (7.3) 
406 (7.0) 
437 (7.5) 
347 (6.5) 
393 (6.0) 
507 (3.1) 
240 (7.0) 
413 (5.0) 
446 (4.5) 
233 (8.1) 
332 (5.2) 


Downloaded from http://pirls2016.org/download-center/ 


10th 
Percentile 


438 (3.9) 
472 (3.4) 
270 (7.0) 
380 (4.4) 


25th 
Percentile 


425 (4.1) 
495 (4.8) 
506 (4.3) 
450 (3.4) 
472 (2.8) 
573 (2.7) 
333 (6.3) 
482 (3.3) 
510 (2.4) 
333 (7.3) 
456 (2.7) 


50th 
Percentile 


529 (2.2) 
552 (2.4) 
415 (7.1) 
527 (3.0) 


75th 
Percentile 


539 (3.1) 
598 (4.0) 
591 (3.2) 
558 (3.6) 
566 (2.5) 
654 (2.6) 
478 (8.2) 
569 (2.0) 
590 (2.1) 
495 (5.9) 
584 (2.3) 


Percentile 


582 (4.3 
636 (5.0 
629 (4.7 
603 (4.5 
603 (3.0) 
689 (2.4) 
544 (9.0) 
604 (2.4) 
623 (2.6) 
557 (5.8) 
630 (2.5) 


) 
) 
) 
) 


Percentile 


605 (3.1) 
660 (5.1) 
650 (5.2) 
630 (7.3) 
623 (3.8 
709 (4.2 
578 (8.6 
624 (2.5 
642 (3.6 
591 (6.4 
656 (3.2) 


) 
) 
) 
) 
) 
) 
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Appendix F.2: Standard Deviations of Reading Achievement 


Re | 


Standard Standard Standard 
Deviation Deviation 


Country e 
Deviation 


2 
R 
Z 
z 
Australia 544 (2.5) 84 (1.6 555 (2.6) 79 (1.8) 534 (3.0) 86 (1.9 o 
Austria 541 (2.4) 65 (1.4) 544 (2.7) 64 (1.4) 538 (2.7) 67 (1.8) 2 
Azerbaijan 472 (4.2) 86 (2.8) 479 (4.3) 84 (3.2) 466 (4.5) 86 (2.9) 2 
Bahrain 446 (2.3) 98 (1.5 468 (2.8) 86 (1.5) 424 (3.5) 105 (2.3 3 
Belgium (Flemish) 525 (1.9) 61 (0.9 530 (2.1) 59 (1.2 520 (2.3) 61 (1.1 5 
Belgium (French) 497 (2.6) 69 (1.3 503 (2.5) 67 (1.5 492 (3.4) 70 (1.8 § 
Bulgaria 552 (4.2) 85 (2.7 559 (4.9) 84 (3.2 544 (4.3) 85 (2.9 € 
Canada 543 (1.8) 76 (1.3 549 (2.2) 75 (1.9 537 (2.1) a (1.3 = 
Chile 494 (2.5) 79 (1.3 501 (2.9) 76 (1.6 487 (3.2) 80 (1.7 4 
Chinese Taipei 559 (2.0) 64 (1.0 563 (2.2) 62 (1.6 555 (2.3) 66 (1.4 > 
Czech Republic 543 (2.1) 68 (2.0 549 (2.2) 65 (2.0 538 (2.6) 71 (2.2 a 
Denmark 547 (2.1) 68 (1.5 554 (2.6) 68 (1.8 541 (2.7) 67 (1.6 in 
Egypt 330 (5.6) 124 (2.8) 349 (5.6 115 (2.8) 312 (6.6) (3.4) g 
England 559 (1.9) 79 (1.2) 566 (2.2) 78 (1.8) 551 (2.4) 80 (13) 2 
Finland 566 (1.8) 67 (1.6) 577 (1.9) 64 (1.6) 555 (2.3) 68 (2.1) 7 
France 511 (2.2) 69 (1.4) 515 (2.6 67 (1.6) 507 (2.5) 71 (1.8) 
Georgia 488 (2.8) 79 (1.6) 498 (2.7 75 (1.7) 479 (3.6) 81 (2.2) 
Germany 537 (3.2) 78 (3.2) 543 (3.2) 76 (3.1) 532 (3.7 79 (4.1) 
Hong Kong SAR 569 (2.7) 64 (1.5) 573 (2.9) 61 (1.6) 564 (3.1) 66 (2.1) 
Hungary 554 (2.9) 75 (1.6) 561 (3.4) 75 (2.1) 548 (3.1) 74 (2.2) 
Iran, Islamic Rep. of 428 (4.0) 108 (2.8) 452 (4.5 98 (3.4) 407 (5.1 111 (3.4) 
Ireland 567 (2.5) 74 (1.5) 572 (2.9 2 (1.8) 561 (3.3 74 (2.3) 
Israel 530 (2.5) 90 (1.8) 537 (2.9 85 (2.3) 524 (3.4) 93 (2.4) 
Italy 548 (2.2) 65 (1.4) 552 (2.7 63 (1.6) 544 (2.4 67 (1.8) 
Kazakhstan 536 (2.5) 63 (1.4) 542 (2.8 62 (1.6) 531 (2.5 63 (1.6) 
Kuwait 393 (4.1) 105 (2.5) 410 (4.8 96 (2.8) 376 (6.4 112 (3.6) 
Latvia 558 (1.7) 62 (1.3) 566 (2.1 61 (1.5) 549 (2.0 63 (1.6) 
Lithuania 548 (2.6) 69 (1.7) Ee (2.7) 68 (1.8) 538 (3.3) 69 (2.2) 
Macao SAR 546 (1.0) 66 (1.0) 46 (1.6) 66 (1.4) 545 (1.7) 66 (1.3) 
Malta 452 (1.8) 90 (1.5 e (2.6) 86 (1.7) 442 (2.2) 92 (2.1 
Morocco 358 (3.9) 107 (1.7) 372 (4.0) 105 (2.3) 344 (4.4) 107 (1.9) 
Netherlands 545 (1.7) 60 (1.2 550 (1.7) 58 (1.2) 540 (2.3) 62 (1.9 
New Zealand 523 (2.2) 91 (1.8 533 (2.4) 88 (2.1) 512 (3.0) 92 (2.3 
Northern Ireland 565 (2.2) 80 (1.3) 574 (2.8) 77 (1.8) 555 (2.8) 83 (2.0) 
Norway (5) 559 (2.3) 65 (1.3) 570 (2.6) 63 (1.7) 548 (2.6) 66 (1.7) 
Oman 418 (3.3) 106 (1.7 442 (3.2) 95 (1.9 395 (3.9) 111 (2.0 
Poland 565 (2.1) 72 (1.1 574 (2.5) 69 (1.7 556 (2.6) 74 (1.6 
Portugal 528 (2.3) 65 (1.4) 529 (2.7) 65 (1.6 527 (2.5) 65 (1.6 
Qatar 442 (1.8) 110 (1.3 460 (1.9) 102 (1.8 424 (3.4) ud (2.4 
Russian Federation 581 (2.2) 66 (1.3 588 (2.2) 65 (1.4 574 (2.6) 67 (1.7 
Saudi Arabia 430 (4.2) 98 (2.4 464 (5.4) 88 (3.2 399 (5.8) 95 (2.5 
Singapore 576 (3.2) 80 (2.1 585 (3.5) 77 (2.1 568 (3.4) 82 (2.6 
Slovak Republic 535 (3.1) 81 (3.6 539 (3.7) 80 (4.2 530 (3.1) 82 (3.5 
Slovenia 542 (2.0) 72 (1.1) 552 (2.3) 69 (1.7) 533 (2.6) 74 (1.5) 
South Africa 320 (4.4) 106 (2.6) 347 (4.0) 99 (2.6) 295 (5.1) 107 (3.1) 
Spain 528 (1.7) 65 (1.4) 532 (1.4) 63 (1.0) 524 (2.7) 67 (2.2) 
Sweden 555 (2.4) 67 (1.2) 563 (2.7) 65 (1.6) 548 (2.6) 68 (1.5) 
Trinidad and Tobago 479 (3.3) 94 (1.9) 490 (3.8) 88 (2.4) 468 (4.4) 98 (2.7) 
United Arab Emirates 450 (3.2) 111 (1.6) 465 (4.2) 102 (2.4) 436 (4.5) 116 (1.9) 
United States 549 (3.1) 78 (1.3) 553 (3.2) 77 (1.5) 545 (3.6) 78 (1.7) 


() Standard errors appear in parentheses. Because of rounding some results may appear inconsistent. 
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Benchmarking Participants 


Buenos Aires, Argentina 
Ontario, Canada 
Quebec, Canada 


Moscow City, Russian Fed. 
Eng/Afr/Zulu - RSA (5) 
Andalusia, Spain 


Abu Dhabi, UAE 


480 (3.1) 
544 (3.2) 
547 (2.8) 
501 (2.7) 
517 (2.0) 
612 (2.2) 
406 (6.0) 
525 (2.1) 
549 (2.0) 
414 (4.7) 
515 (1.9) 
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Standard 
Deviation 


62 (1.1) 


103 (2.7) 


64 (1.4) 
60 (1.0) 


109 (2.4) 


98 (1.4) 


485 (3.7) 
550 (3.6) 
552 (3.3) 
511 (3.3) 
526 (2.4) 
620 (2.3) 
421 (6.0) 
526 (2.8) 
553 (2.4) 
435 (7.3) 
522 (3.6) 


Appendix F.2: Standard Deviations of Reading Achievement 
(Continued) 


Standard 
Deviation 


82 (2.4 
76 (2.2 
65 (2.4 
83 (2.3 
66 (1.2) 
61 (1.2) 
97 (3.0) 
64 (1.9) 
59 (1.7) 


) 
) 
) 
) 


103 (3.8) 


96 (2.3) 


475 (3.4) 
538 (3.8) 
542 (3.1) 
491 (3.0) 
508 (2.1) 
604 (2.6) 
391 (6.5) 
523 (2.2) 
545 (2.6) 
396 (6.4) 
509 (2.8) 
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APPENDIX G 


Organizations and Individuals 
Responsible for PIRLS 2016 


Introduction 


PIRLS (Progress in International Reading Literacy Study) is a collaborative effort involving hundreds 
of individuals around the world. This appendix acknowledges the individuals and organizations 
who contributed to the assessment. Given that work on PIRLS 2016 has spanned approximately 
five years and has involved so many people and organizations, this list may not include all who 
contributed. Any omission is inadvertent. PIRLS 2016 also acknowledges the students, parents, 
teachers, and school principals who contributed their time and effort to the study. It would not be 
possible without them. 


Management and Coordination 


PIRLS is a major undertaking of IEA, and together with TIMSS (Trends in International Math and 
Science Study), comprises the core of IEA’ regular cycles of studies. The PIRLS assessment at the 
fourth grade complements TIMSS, which regularly assesses science and math achievement at the 
fourth and eighth grades. 

PIRLS was conducted by IEA’s TIMSS & PIRLS International Study Center at Boston College, 
which has responsibility for the overall direction and management of the TIMSS and PIRLS projects, 
including design, development, and implementation. Headed by Executive Directors Drs. Ina VS. 
Mullis and Michael O. Martin, the study center is located in the Lynch School of Education. In 
carrying out the project, the TIMSS & PIRLS International Study Center worked closely with IEA 
Amsterdam, which managed country participation, was responsible for verification of all translations 
produced by the participating countries, and coordinated the school visits by International Quality 
Control Monitors. Staff at IEA Hamburg worked closely with participating countries to organize 
sampling and data collection operations and to check all data for accuracy and consistency within 
and across countries; Statistics Canada in Ottawa was responsible for school and student sampling 
activities; The Australian Council for Educational Research (ACER) participated in developing 
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the ePIRLS tasks and items, and ACER and the National Foundation for Educational Research in 
England (NFER) participated in developing the PIRLS 2016 passages and items; and Educational 
Testing Service in Princeton, New Jersey consulted on psychometric methodology, provided software 
for scaling the achievement data, and replicated the achievement scaling for quality assurance. 

The Project Management Team, comprising the study directors and representatives from the 
TIMSS & PIRLS International Study Center, IEA Amsterdam and IEA Hamburg, Statistics Canada, 
and ETS met twice a year throughout the study to discuss the study’s progress, procedures, and 
schedule. In addition, the study directors met with members of IEA’s Technical Executive Group 
twice yearly to review technical issues. 

To work with the international team and coordinate within-country activities, each participating 
country designates an individual to be the PIRLS National Research Coordinator (NRC). The NRCs 
have the challenging task of implementing PIRLS in their countries in accordance with the PIRLS 
guidelines and procedures. In addition, the NRCs provide feedback and contributions throughout 
the development of the PIRLS assessment. The quality of the PIRLS assessment and data depends 
on the work of the NRCs and their colleagues in carrying out the complex sampling, data collection, 
and scoring tasks involved. Continuing the tradition of exemplary work established in previous 
cycles of PIRLS, the PIRLS 2016 NRCs performed their many tasks with dedication, competence, 
energy, and goodwill. 


Funding 


Funding for PIRLS 2016 was provided primarily by the participating countries. The National 
Center for Education Statistics of the U.S. Department of Education was a major funding partner, 
providing funding under contract number ED08C00117. The content of this publication does not 
necessarily reflect the views or policies of the U.S. Department of Education nor does mention of 
trade names, commercial products, or organizations imply endorsement by the U.S. Government. 
Boston College also is gratefully acknowledged for its generous financial support and stimulating 
educational environment. 
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TIMSS & PIRLS International Study Center at Boston College 

Ina V.S. Mullis, Executive Director 

Michael O. Martin, Executive Director 

Pierre Foy, Director of Sampling, Psychometrics, and Data Analysis 

Paul Connolly, Director, Graphic Design and Publications 

Marcie Bligh, Manager, Events and Administration 

Katie Trong Drucker, PIRLS Coordinator (through 2013) 

Susan Farrell, Lead Web and Database Designer 

Bethany Fishbein, Research Specialist, Instrument Development and Reporting 

Elena Forzani, Assistant Research Director, PIRLS (from 2015) 

Joseph Galia, Lead Statistician/Programmer 

Shirley Goh, Assistant Director, Communications and Media Relations 

Christine Hoage, Manager of Finance 

Kathleen Holland, Administrative Coordinator 

Martin Hooper, Assistant Research Director, TIMSS and PIRLS Questionnaire Development 

and Policy Studies 

leva Johansone, Associate Research Director, Operations and Quality Control 

Cristian Leiva, Front-End Web Developer 

Lauren Palazzo, Research Associate, TIMSS and PIRLS Questionnaire and Technical Reporting 

Yenileis Pardini, Lead Designer/Developer for eAssessments 

Mario Pita, Lead Graphic Designer 

Jyothsna Pothana, Statistician/Programmer 

Betty Poulos, Administrative Coordinator (through 2016) 

Caroline Prendergast, Research Associate, PIRLS 

Ruthanne Ryan, Senior Graphic Designer 

Jennifer Moher Sepulveda, Data Graphics Specialist (through 2015) 

Steven A. Simpson, Senior Graphic Designer 

Erin Wry, Research Associate, TIMSS and PIRLS Operations and Quality Control 

Liqun Yin, Research Psychometrician 


IEA Amsterdam 

Dirk Hastedt, Executive Director 

Hans Wagemaker, Executive Director (through 2014) 

Paulina Korsnakova, Director of the IEA Secretariat (through 2016) 
Andrea Netten, Director of the IEA Secretariat 

Barbara Malak, Manager, Member Relations (through 2013) 

Roel Burgers, Financial Director 
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Juriaan Hartenberg, Financial Manager (through 2013) 
Gabriela Nausica Noveanu, Senior Research Advisor 
David Ebbs, Senior Research Officer 
Michelle Djeki¢, Research and Liaison Officer 
Isabelle Braun-Gémin, Financial Officer 
Dana Vizkova, Financial Officer 
Gillian Wilson, Publications Officer 
Manuel Butty, Public Outreach Officer (through 2016) 


IEA Hamburg 


Heiko Sibberns, IEA Hamburg Director 

Oliver Neuschmidt, Senior Research Analyst, Unit Head, International Studies 
Milena Taneva, Senior Research Analyst, Project Co-Manager, PIRLS Data Processing 
Juliane Hencke, Senior Research Analyst, Project Co-Manager, PIRLS Data Processing 
Sebastian Mayer, Research Analyst, Deputy Project Manager, PIRLS Data Processing 
Mark Cockle, Research Analyst, Deputy Project Manager, PIRLS Data Processing 
Yasin Afana, Research Analyst 

Alena Becker, Research Analyst 

Clara Beyer, Research Analyst 

Christine Busch, Research Analyst 

Tim Daniel, Research Analyst 

Limiao Duan, Programmer 

Eugenio Gonzalez, Senior Research Analyst 

Michael Jung, Research Analyst 

Deepti Kalamadi, Programmer 

Hannah Kohler, Research Analyst 

Kamil Kowolik, Research Analyst 

Sabine Meinck, Senior Research Analyst, Head of Research, Analysis & Sampling Unit 
Ekaterina Mickheeva, Research Analyst 

Dirk Oehler, Research Analyst 

Duygu Savasci, Research Analyst, Sampling Team 

Sabine Tieck, Research Analyst, Sampling Team 

Meng Xue, Unit Head, Software 
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Statistics Canada 


Sylvie LaRoche, Senior Methodologist 

Marc Joncas, Senior Methodologist (through 2015) 
Ahmed Almaskut, Methodologist 

Shou Xiang Chen, Methodologist (through 2016) 


Educational Testing Service 


Edward Kulick, Research Director 

Jonathan Weeks, Associate Research Scientist 
Timothy C. Davey, Research Director Special Projects 
Sandip Sinharay, Principal Research Scientist 

Scott Davis, Senior Research Data Analysis Consultant 


Sampling Referee 
Keith Rust, Vice President and Associate Director of the Statistical Group Westat, Inc. 


PIRLS 2016 Reading Development Group 


Julian Fraillon Jenny Wiksten Folkeryd 

Australian Council for Educational Research Uppsala University 

Australia Sweden 

Jan Mejding Ahlam Habeeb Msaiger 

Department of Education Abu Dhabi Education Council 

Aarhus University United Arab Emirates 

SEninats Marian Sainsbury, Chief Reading Consultant 
Galina Zuckerman National Foundation for Educational Research 
Psychological Institute United Kingdom 

Russian Academy of Education Donald Lea 


Russian’ Federation University of Connecticut 


Elizabeth Pang United States 
Curriculum Planning and Development Raven Wixtor 
Division University of North Carolina, Greensboro 

Ministry of Education United States 

Singapore 
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PIRLS 2016 Item Development Task Force 


Prue Anderson Liz Twist 

Australian Council for Educational Research National Foundation for Educational Research 
Australia United Kingdom 

Marian Sainsbury, Chief Reading Consultant Karen Wixson 

National Foundation for Educational Research — University of North Carolina, Greensboro 
United Kingdom United States 


PIRLS 2016 Questionnaire Development Group 


Joanne Latourelle Maryam A. Al-Ostad 
Coordonnatrice aux études pancanadiennes et National Centre for Education Development 
internationationales, Sanction des études, Kuwait 
Ministére de Education, du Loisir et du Megan Chamberlain 
Sport Comparative Education Research Unit 
ae Ministry of Education 
Hwa Wei Ko New Zealand 


Graduate Institute of Learning and Instruction 


National Central University 
Chinese Taipei 


Joao Maroco 

Instituto de Avaliagao Educativa, I.P. 
Portugal 

Marc Colmant 

Ministére de léducation nationale 

Direction de lévaluation, de la prospective et de 


Sarah Howie 
Centre for Evaluation and Assessment 


University of Pretoria 
la performance South Africa 
France 


PIRLS 2016 National Research Coordinators 


Australia Bahrain 

Sue Thomson Huda Al-Awadi 

Australian Council for Educational Research Ministry of Education 

Austria Belgium (Flemish) 

Christina Wallner-Paschon Kim Bellens 

Birgit Suchan (through 2014) Centrum voor Onderwijseffectiviteit en 
Bundesinstitut fuer Bildungsforschung, evaluatie 


Innovation und Entwicklung des 


Belgium (French) 
Oesterreichieschen Schulwesens (BIFIE) 


Anne Matoul 
Azerbaijan Genevieve Hindryckx (through 2014) 
Narmina Aliyeva Université de Liege 
Ministry of Education 
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Bulgaria 

Marina Vasileva Mavrodieva 

Center for Assessment in Pre-School and 
School Education (CAPSE) 


Canada 

Kathryn O'Grady 

Tanya Scerbina 

Pierre Brochu (through 2016) 
Mélanie Labrecque (through 2015) 
Council of Ministers of Education 


Chile 

Carolina Leyton 

Maria Victoria Martinez Munoz (through 
2016) 

Departamento de Estudios Internacionales 

Division de Estudios 

Agencia de Calidad de la Education 


Chinese Taipei 

Hwa Wei Ko 

Graduate Institute of Learning and Instruction 
National Central University 


Czech Republic 
Zuzana Janotova 
Czech School Inspectorate 


Denmark 

Jan Mejding 

Aarhus University Department of Education 
(DPU) 


Egypt 

Shokry Sayed Ahmed 

National Center of Examinations and 
Educational Evaluation 
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England 

Grace Grima 

Kath Thomas (through 2015) 
Pearson 


Finland 

Kaisa Leino 

Inga Carita Arffman (through 2016) 
Finnish Institute for Educational Research 
University of Jyvaskyla 


France 

Marc Colmant 

Ministére de léducation nationale 

Direction de Il’ évaluation, de la prospective et 
de la performance (DEPP) 


Georgia 

Natia Andguladze 

Nutsa (Magda) Kobakhidze (through 2013) 
National Assessment and Examination Center 


Germany 

Wilfried Bos 

Heike Wendt 

Institut fiir Schulentwicklungsforschung 
TU Dortmund University 


Hong Kong SAR 

Tse Shek Kam 

The University of Hong Kong 
Faculty of Education 


Hungary 

Ildik6 Balazsi 

Péter Balkanyi 

Educational Authority 

Department of Assessment and Evaluation 


Iran, Islamic Republic of 

Abdol’azim Karimi 

Research Institute for Education (RIE) 
Ministry of Education 
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Ireland Morocco 
Eemer Eivers Mohammed Sassi 
Educational Research Centre Centre National de L Evaluation et des 


Examens et de Orientation 
Ministere de PEducation Nationale et de la 
Formation Professionnelle 


Israel 
Inbal Ron-Kaplan 
National Authority for Measurement and 


Evaluation in Education (RAMA) The Netherlands 
aly Joyce Gubbels 
aie Palmienie Andrea Netten (through 2016) 
Elisa Caponera (through 2013) National Language Education Center, 
INVALSI - Istituto Nazionale per la Expertisecentrum Nederlands 
Valutazione del Sistema Educativo di New Zealand 
Istruzione e di Formazione Megan Chamberlain 
vascincan Comparative Education Research Unit, EDK 
Aigul Baigulova Ministry of Education 
Gulmira Berdibayeva (through 2014) Northern Ireland 
Ministry of Education and Science JSC Juliet Sizmur 
Information-Analytic Center National Foundation for Educational Research 
Kuwait (NFER) 
Maryam A. Al-Ostad Norway 
National Centre for Education Development Egil Gabrielsen 
bona National Centre for Reading Education and 
Antra Ozola ea ch 
University of Latvia University of Stavanger 
Faculty of Education, Psychology, and Art Oman 
enhuanig Zuwaina Saleh AlMaskari 
Ramute Skripkiene Ministry of Education 
Irina Mackeviciene (through 2016) Poland 
National Examination Centre Michal Federowicz 
Ministry of Education and Science Krzysztof Konarzewski 
Macao SAR Educational Research Institute 
Wong ILin, Irene Portugal 
Wai Ki Yiao Joao Maroco 
Man Hio Fai (through 2016) Ana Sousa Ferreira (through 2013) 
Education and Youth Affairs Bureau (DSEJ) Instituto de Avaliagao Educativa, I.P. 
Malta 
Charles Mifsud 
Centre for Literacy 
University of Malta 
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Qatar Spain 
Badriya Salman Al-Mohannadi Veronica Diez Girado 
Ameena Abdulla Alobaidli (through 2015) Beatriz Sanz Sumelzo (through 2016) 
Saada Hassan Alobaidli (through 2014) Jose Maria Sanchez-Echave (through 2015) 
Student Assessment Office Ministerio de Educacion, Cultura y Deporte 
Ministry of Education and Higher Education Instituto Nacional de Evaluacién Educativa 
Russian Federation Sweden 
Galina Kovaleva Agnes Tongur 
Institute of the Strategies of Educational Elina Ekberg 
Development Tomas Matti (through 2014) 
Russian Academy of Education Swedish National Agency for Education 
Moscow Center Quality of Education (SKOLVERKET) 
Saudi Arabia Trinidad & Tobago 
Mohammed Majre Al-Sobeiy Peter Smith 
Saleh Alshaya (through 2013) Division of Educational research and 
General Directorate of Evaluation Evaluation 
Ministry of Education Ministry of Education 
Singapore United Arab Emirates 
Elizabeth Pang Moza Rashid AlGhufli 
Chan Lee Shan Ayesha Ghanim Khalfan Almerri (through 
Ng Huey Bian (through 2015) 2016) 
Curriculum Planning and Development Nada Abu Baker Husain Ruban (through 2015) 
Division Maryam Mohammed Sulaiman (through 2015) 
Ministry of Education Aljawhara Ali AlSebaiei (through 2014) 
Assessment Department 


Slovak Republic 


awaaC ere Ministry of Education 

Eva Ladanyiova (through 2016) United States 

Sona Gallova (through 2013) Sheila D. Thompson 

National Institute for Certified Educational National Center for Education Statistics 
Measurements (NUCEM) US. Department of Education 


Slovenia 
Marjeta Doupona 
Educational Research Institute 


Benchmarking Participants 
Buenos Aires, Argentina 
Tamara Viancur 


South Africa Ines Cruzalegui (through 2015) 

Sarah Howie Silvia Montoya (through 2015) 

Surette van Staden (through 2014) Unit for the Comprehensive Evaluation of 
Centre for Evaluation and Assessment (CEA) Educational Quality and Equity 


University of Pretoria 
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Ontario, Canada Madrid, Spain 

Richard Jones Luis Pires Jimenez 

Angela Hinton (through 2015) Regional Ministry of Education, Youth, and 

Education Quality and Accountability Office Sports 

Quebec, Canada Abu Dhabi, United Arab Emirates 

Joanne Latourelle Shaikha Ali Al Zaabi 

Sanction des études, Ministére de Education, | Nasreen Hussain Al Marzoogi (through 2013) 
et de l’Enseignement Supérieur Ahlam Habeeb Msaiger 


Assessment Department 


Moscow City, Russian Federation 
Abu Dhabi Education Council 


Zozulya Elena Stanislavovna 

Moscow Center for Quality of Education Dubai, United Arab Emirates 

Mariam Al Ali 

Rabaa AlSumaiti (through 2014) 

Knowledge and Human Development 
Authority 


Andalusia, Spain 
Sebastian Cardenas Zabala 
Agencia Andaluza de Evaluacion Educativa 
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* Macy and the Red Hen 
- The Green Sea Turtle’s Journey of a Lifetime 
* Flowers on the Roof 


* The Pear! 
* African Rhinos and Oxpecker Birds 


“IRKLS Z a IINITERINATIUNAL RES 


IN REAUVIN(A 


PIRLS 
Rae lay 


PATS 


All publications and restricted use items by TIMSS, PIRLS and other IEA studies, as well as translations thereof, are 

for non-commercial, educational and research purposes only. Prior permission is required when using IEA data 

sources for assessments or learning materials. IEA Intellectual Property Policy is inter alia included on the IEA 

website (http://rms.iea-dpc.org/). IEA copyright must be explicitly acknowledged (© IEA 2017), and the need to obtain 
permission for any further use of the published text/material clearly stated in the requested use/display of this material. 


_ TIMSS & PIRLS 
CF IEA International Study Center 


Lynch School of Education 
BOSTON COLLEGE 


Macy and the Red Hen 


By Prue Anderson 


Macy unclipped the cage door. She pulled it 
open and she smiled as a cloud of hens exploded 
into the yard. With much feather shaking and 
squawking they settled down to eat the dinner 
scraps Macy had scattered for them. As usual, 
the red hen took charge, grabbing the best 
scraps, pecking at any hen that 

dared get in its way, flapping 
and fussing this way 
and that. 


“Why do the other hens let the red hen boss them like that?” Macy had 
asked her mother. 


“Hens have a pecking order,” her mother explained. “The bravest and 
strongest hen is in charge. She can peck all the other hens, but no one can 
peck her. The next hen in the pecking order can peck everyone except the 
top hen and so it goes all the way down, so you feel really sorry for the poor 
hen at the bottom. Hens like a bossy leader.” 
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But Macy had a different view. Every night she had to lock the hens 
back in their cage so that foxes and owls did not get them. This was her 
job. Everyone in her large family had jobs. By the time it was getting dark, 
all the hens were happy to go back into their cage. That is, all except the 


red hen. She would pretend to walk towards the cage door, and at the last 
minute would suddenly rush to the side and wait for Macy to chase her. 


Another trick was to sit in the middle of the yard. As soon as Macy 
got close enough to bend down and pick her up, the hen would flap her 
wings really hard so Macy could not grab her, then she would run off 
again. Eventually, after the red hen had decided that Macy had chased her 
enough, she would calmly walk into the cage by herself, her little red eyes 
gleaming in triumph as Macy slammed the cage door behind her. 
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Macy had tried to lure the red hen by putting her favorite food inside 
the cage at night, but the hen would not be bribed. Macy had tried banging 


pot lids together to frighten the red hen, but she scared the other hens so 
much they did not lay any eggs for two days. 


Macy went to find her father. “I 
need to teach that red hen a lesson,” 
she said. “I’m going to leave her out 
all night to fight the foxes and the 
owls. That will teach her to go in her 
cage when I say.” 


“Macy,” said Dad, as he turned 
to look at her. “A hen cannot fight an 
owl or a fox and we need our hens. 
We need all the eggs we can get.” 


He smiled. “Besides, it would not 
solve your problem, because the next 
hen in the pecking order would just 
take the red hen’s place.” He turned 
back to his work. 
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Macy stomped to the kitchen. “Mum, I don’t like my job, I need a 
different job.” 


“Well that’s easy,” said Mum. 
“You can cook dinner.” Macy 
looked at the huge pile of food on 
the bench that had to be cleaned 
and chopped and stirred to feed 
all of her family. 


“You can wash the 
dishes.” Macy looked at the 
stack of dirty pots and pans 
from last night still piled up on 
the sink. 


“You can look after the 
baby.” Macy looked at her 
little sister happily squashing 
banana into her face, her hair, 
and her clothes. 


Macy retreated out the 
kitchen door. “I would like your 
job,” her mother called after her. 
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That night as Macy was chasing the red hen 


around the yard she saw an owl gliding down on 
the other side of the yard fence. 


ea 
a : 
xe . 


The owl 
swooped across 
the grass on x ; 
its huge white wings, 
grabbed a mouse in its 
claws, and soared back into the 
shadows. This gave Macy an idea. The next i Macy 
got wire and some white cloth and made two big wings 
on the end of a long pole. She explained her plan to her 
brother Sam. 


That night when Macy was chasing the red hen as usual, Sam stepped 
into the yard with the pole that Macy had made. He made the wings 
swoop down towards the red hen. The hen stopped running and fluffed up 
her feathers, squawked furiously and beat her wings, ready to face her 
attacker, but the white wings kept coming closer and closer. The red hen’s 
squawking faded away. She crouched down low on the ground, her beak 
pointing up ready to peck if she got the chance. Suddenly, Macy stepped in. 
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Macy shouted at the white wings. She hit the wings with her hands 
and pushed the wings away. Her brother lifted the wings upwards. Down 
they came again and Macy fought them off. The red hen’s beady little eyes 
watched it all as she crouched at Macy’s feet. Finally, the terrifying wings 
gave up and flew away. 


Macy bent down and put out her hands. The red hen rushed into them 
and gently laid her beak on Macy’s arm. Macy could feel the hen’s little 
heart pounding in her feathery chest as she carried her back to the cage. 
She cuddled the hen until its heart slowed down then gently put it in the 
cage and smiled at Sam. 


“Now you are the top of the pecking order,” laughed Sam. 


APPENDICES TIMSS & PIRLS 


ZZ International Study Center 340 
PIRLS 2016 INTERNATIONAL RESULTS IN READING Zw IEA Eyrich School of Education 
Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


( 


PIRLS 
2016 CP srade 
Questions Macy and the Red Hen 


1. What is Macy doing at the start of the story? 
() catching a hen 
+ feeding the hens 


© looking for eggs 


(©) collecting feathers 


2. | How does the author show you what the red hen is like? 
(A) by describing what the red hen looks like 
by describing the red hen’s favorite food 
© by describing where the red hen lives 


+ (0) by describing how the red hen behaves 


a 
3. Why does Macy’s mother feel sorry for the hen at the bottom of the @ 
pecking order? (0) 
* Correct Answer 
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4. Why does the red hen play tricks on Macy? 


OO©l©O 


5. Why does Macy slam the cage door? 
+ () Macy is angry. 
The door is hard to close. 
© A fox is coming. 


(©) The red hen is escaping. 


6. Macy wants the red hen to go into the cage. 


What are two things Macy does that do not work? 


A). 


CIONETETO 


(A) 2. 


> Correct Answer 
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7. Why does Dad object to Macy’s idea? 
(A) The red hen might hurt itself. 
The red hen would stop laying eggs. 


+ © Dad thinks the red hen would be killed. 


©) Dad wants to teach the hen a lesson. 


8. Dad says the next hen in the pecking order would just take the red 
hen’s place. 


What does he mean? 


QO©|©OO 


9. Why does Mum say, “I would like your job”? 
() Mum feels sorry for Macy. 
Macy should do more jobs around the house. 
© Mum really likes looking after hens. 


+ (©) Macy should understand Mum has harder jobs. 


>% Correct Answer 
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10. How does Macy get her idea? 
() Macy’s brother, Sam, tells her the plan. 


+ Macy sees an owl catch a mouse. 


© Macy’s Dad tells her about owls. 


(©) Macy sees wire and some white cloth. 


11. Why does Macy make white wings on a pole? 
@) to look like hen’s feathers 
to make a decision 
© to look like an owl 


(©) to impress Sam 


3} 
12. Macy “hit the wings with her hands and pushed the wings away.’ 


What does Macy want the hen to think? 
a () that Macy is saving the hen 

that Macy is angry with the hen 

© that Macy is terrified of the owl 


(©) that Macy is playing with the owl 


>* Correct Answer 
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13. You learn what Macy is like from the things she does. 


Describe what Macy is like and give two examples from the story 
that show this. 


QEQ|OO0®L 


14. Why is Macy at the top of the pecking order at the end of the story? 


Use the information from the story to explain your answer. 


OQE©|©OO 


15. What do you think the red hen will do next time Macy puts the hens 
in their cage? 


Qe©/©O 
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16. Why would “Macy Finds a Way” be good as a different title for this 
story? 


Give one reason. 


QO©/©O 


Text by Prue Anderson, printed with her permission. Illustrations by TIMSS & PIRLS International Study Center, 
Boston College. 
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Macy and the Red Hen, Item 3 


3. Why does Macy’s mother feel sorry for the hen at the bottom of the pecking 
order? 


Process: Make Straightforward Inferences 


1 - Acceptable Response 


The response indicates that all the other hens peck it, or it cannot peck anyone, or that 
it gets the worst conditions. 


Examples: 

- All the other hens can peck it. 

- It cannot peck any other hens. 

- He gets bossed around. 

- The leader of the hens keeps bossing her around. 


- Because it gets the worst scraps for dinner. 


0 - Unacceptable Response 


The response indicates misunderstanding of the pecking order or is vague, unrelated to 
the text, or repeats words in the question. 

Examples: 

- It might be sick. 

- All the other hens sit on top of it. 

- Because it is a long way to go to be the boss. 


- Because hens like a bossy leader. 
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Macy and the Red Hen, Item 4 
4. Why does the red hen play tricks on Macy? 


Process: Interpret and Integrate Ideas and Information 


1 - Acceptable Response 


The response indicates that the red hen is top of the pecking order, or the boss, or 
thinks she is better. 


Examples: 

- The hen is top of the pecking order. 

- The hen is bossy. 

- It does not want to do what Macy says because it is the boss. 
- Just to show she is better than Macy. 

- The red hen thinks she’s the best. 


- The red hen thinks because it is the bravest and strongest it can play tricks. 


0 - Unacceptable Response 


The response indicates misunderstanding of the red hen’s intentions. It may be vague, 
unrelated to the text, or repeat words in the question. 


Examples: 

- The hen does not like being in the cage. 
- The hen wants to stay out all night. 

- The hen is naughty. 

- It does not like Macy. 

- It does not want to go back in the cage. 
- It does not want to do what Macy says. 
- The hen wants Macy to chase it. 
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Macy and the Red Hen, Item 6 


6. Macy wants the red hen to go into the cage. 


What are two things Macy does that do not work? 
Process: Focus on and Retrieve Explicitly Stated Information 


2 - Complete Comprehension 

The response includes two of the following: 

e Picking up the hen. 

e Putting food inside the cage/luring the hen with food. 
e Banging lids together/making noise (to scare the hen). 


e Chasing the hen. 


1 - Partial Comprehension 


The response indicates one of the above. 


0 - No Comprehension 


The response indicates a successful strategy or is incorrect. It may be vague, unrelated 
to the text, or repeat words in the question. 


Examples: 

- Macy makes an owl and scares the red hen. 
- Macy leaves the hen out all night. 

- Sam helps Macy. 

- She scares the hen. 

- Uses the wings. 


- Leaves it out at night. 
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Macy and the Red Hen, Item 8 


8. Dad says the next hen in the pecking order would just take the red hen’s place. 


What does he mean? 
Process: Evaluate and Critique Content and Textual Elements 


1 - Acceptable Response 


The response shows understanding that (even if the red hen is killed) the pattern will 
continue; Macy’s problems will not be solved; the next hen will cause the same 
trouble/problem; or will behave/be annoying in the same way as the red hen. 


Examples: 
- The cycle would continue and there is no point letting the fox get the hen. 


- It means that even when the red hen is killed, the next hen in the pecking 
order will carry on doing the same thing. 


- There will just be another hen to annoy Macy. 


- Hemeans the red hen would die and the next hen in the pecking order 
would still be like the red hen. 


- The next hen in the pecking order would take the red hen’s place and do the 
same. 

- He means that the next hen will do exactly the same thing that the red hen 
did. 


- Macy’s problems would not be solved. 


0 - Unacceptable Response 


The response may or may not refer to another hen replacing the red hen as the leader, 
but it does not show understanding that the pattern or problem will continue. 


Examples: 

- The second hen will be the top hen. 

- Another hen will take over as boss. 

- It means the next hen in the pecking order will be in charge. 

- Ifthe red hen goes, it will be replaced by a new leader. 

- The hen that is second bravest and strongest would take its place. 
- It means the red hen will be killed. 

- That this won't change anything (too vague) 

- Dad is going to put another hen in charge. 
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Macy and the Red Hen, Item 13 


13. You learn what Macy is like from the things she does. 


Describe what Macy is like and give two examples from the story that show this. 
Process: Interpret and Integrate Ideas and Information 


3 - Extensive Comprehension 


The response shows understanding of what Macy is like by giving at least one trait, 
feeling, or attitude that is supported with two different, appropriate examples OR two 
traits/feelings/attitudes with an example for each. Possible attributes and actions are 
listed below, but Macy is a complex character and other responses may be acceptable if 
appropriately supported. 
Examples: 
- Macy is determined because she does not give up when the red hen is 
naughty and she continues to try different ways to get the hen in the cage. 
- Macy has a bad temper because she slams the hen’s cage shut and she 
stomps angrily into the kitchen. 


- She is clever because she comes up with the idea of wings and she tries 
putting the hen’s favorite food in the cage to lure her in the cage. 

- She is responsible because she makes sure the hens are safe and creative 
because she comes up with the plan to use the owl. 

- Macy is smart because she got the hen in the cage. Macy does not give up 
because she tried 4 or 5 times. 


Possible attributes and actions 


e Smart, clever, inventive: thinks of creative solutions to her problem. 


e Determined, intolerant of failure: does not give up until she is successful; gets 
annoyed by hen’s behavior. 


e Conscientious: carries out her responsibilities each day. 


e Curious, questioning: asks questions to understand the problem. 


2 - Satisfactory Comprehension 
The response shows understanding of what Macy is like by linking a 
trait/feeling/attitude with one appropriate example. 


Example: 
- She is moody and angry at the hen. She wants the hen to do what it is told. 
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1 - Minimal Comprehension 


The response lists one or more of Macy’s traits/feelings/attitudes: (e.g., determined, 
clever) with only a vague example or without an example. The response does not 
include contradictory traits or behaviors. 


Examples: 

- She is clever and smart. 

- She thinks of lots of good ideas. 
- She keeps on trying and trying. 
- She gets angry or frustrated. 


0 - Unsatisfactory Comprehension 


The response does not describe a trait/feeling/attitude, it may list unrelated traits, be 
vague, unrelated to the text, or repeat words in the question. 

Examples: 

- She is nice/kind/helpful/good. (too generic) 

- She does lots of good things. 

- She is caring, smart, pretty, kind, loving. (unrelated traits) 

- She is angry and smiley. (contradictory) 

- Sheis angry and happy. (contradictory) 


- She likes what she does. (incorrect) 
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Macy and the Red Hen, Item 14 


14, Why is Macy at the top of the pecking order at the end of the story? 


Use the information from the story to explain your answer. 
Process: Interpret and Integrate Ideas and Information 


1 - Acceptable Response 
The response refers to Macy’s clever plan, the hen being saved/scared, or Macy scaring 
away the owl. 
Examples: 
- She tricked the hen then the hen thought Macy was better. 
- Macy pretended to save the hen. 
- The red hen thinks Macy saved it. 
- The hen thinks Macy is brave. 
- She saved the red hen from the owl. 
- She scared away the owl. 
- She scared the red hen. 


0 - Unacceptable Response 
The response is vague, unrelated to the text, or repeats words in the question. It may 
provide a literal definition of the pecking order. 

Examples: 

- Macy is in charge. 

- Macy is bossy. 


- Because Sam said it. 
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Macy and the Red Hen, Item 15 


15. What do you think the red hen will do next time Macy puts the hens in their 
cage? 


Process: Interpret and Integrate Ideas and Information 


1 - Acceptable Response 
The response indicates that the hen will behave. 
Examples: 
- She will just sit down until Macy comes and picks her up. 
- She will go in the cage and not make it difficult. 
- She will follow the others into the cage. 
- She will remember what she did and stay there. 
- It will go in the cage with the others. 
- It will go in straight away. 
- It will be obedient. 


0 - Unacceptable Response 
The response is vague, unrelated to the text, or repeats words in the question. 
Examples: 
- She might do the same thing. 
- Runaway. 
- The hen would get angry. 
- She won't fall for Macy’s trick. 


- She wants Macy to chase her. 
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Macy and the Red Hen, Item 16 


16. Why would “Macy Finds a Way” be good as a different title for this story? Give 
one reason. 


Process: Evaluate and Critique Content and Textual Elements 


1 - Acceptable Response 

The response indicates that Macy was able to solve her problem. 
Examples: 
- She did find a way to make the hen do what she wanted. 
- She tricked the red hen into doing what Macy wanted. 
- She finds a way to teach the hen a lesson. 
- She finds a way to get the hen in the cage. 
- Because she finds a way for the hen to listen to her. 


- She finds a way to get the hen in the cage without putting up a fight. 


0 - Unacceptable Response 
The response is vague, unrelated to the text, or repeats words in the question. 
Examples: 
- She did find a way. 
- Because it is about her doing it. 
- Macy found a way in the story. 
- She wants to be friends with the hen. 
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The Green Sea Turtle’s 
Journey ofa Lifetime 


From Turtle Travels 
By Gary Miller 


Out From the Sand 


It’s a starry night in August. A nest of eggs lies buried in the sand more 
than two feet below the surface of a Costa Rican beach. The nest holds more 
than 100 green sea turtle eggs, each about the size of a golf ball. 


One of the baby sea turtles begins to stir and hatch from her egg. The 
hatchling tears at the shell of her egg with the sharp point on her beak. 
Still buried beneath the sand, the baby sea turtle breaks free. Soon, the 
whole nest is alive with motion. 


The baby turtle uses her flippers to climb up and up. It can take more 
than a day to reach the surface of the sand. 
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Into the Water 


When the hatchling reaches the surface of the sand, she is drawn to the 
moonlight reflecting off the ocean. Luckily, there are no lights shining from 
a nearby street or house. These lights can confuse a baby turtle. They can 
make it go the wrong way, away from the sea. 


The hatchling’s journey to the water is a race for survival. She is no 
bigger than a walnut. Crabs and birds, such as night herons, snatch up 
some of the other baby turtles on the beach. This baby turtle makes it to 
the water. 


The frothy surf pushes the baby turtle back. She fights to swim against 
the breaking waves. The hatchling continues to swim through the first day 
and night, and she does not slow down for two days. 


Out to the Open Sea 


The baby turtle’s journey 
through the open sea is often 
called the “lost years.” Scientists 
know little about this phase of a 
ereen sea turtle’s life. She may 
move with the currents, floating 
with mats of seaweed. 


The hatchling may snack 


on shrimp, small jellyfish, and 
snails that drift in and around 
the seaweed. Unfortunately, the sea also contains plastic and trash that 
people throw away. Eating them could be deadly for the turtle. 
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The sea has many other dangers, too. Predators such as sharks swim 
below the small turtle and large birds fly above. Fortunately, she gets some 
protection from the coloring of her shell. The bottom is almost white, so 


sharks swimming below may not spot her in the sunlight. The top of her 
shell is dark, so from above the turtle blends into the dark water. 


Growing Up Green 


After several years, she has become a juvenile. She is no longer a hatchling, 
but she is not yet an adult. Her shell has become about the size of a dinner 


plate. It is now time to leave the open sea for the warm coastal waters of 
Florida, USA. 


With her larger shell she is safer than she was as a hatchling. Although 
she sometimes slurps up a jellyfish, now she mostly eats algae and sea 
erass. 


Years pass as she slowly 
erows. She moves farther off 
shore to feeding grounds where 
she becomes an adult. 


At night, she rests in the 
water under rocks and ledges, 
holding her breath for up to five 
hours. Each day, she returns 
to the same patch of sea grass 
called turtle grass. Like a lawn 


mower, the turtle keeps this sea grass pasture cut short. Eating sea grass 
and algae turns her body fat a green color. In fact, this is how green sea 
turtles get their name! 
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Back to the Sand 


FLORIDA, 
When the turtle is USA 
about 26 years 

old, her adult shell 
is over 3 feet long 
and she weighs 
around 300 pounds. 
Now she sets out on 
a new adventure. 
She begins her long 
trek back to the 
beach where she was 
born. She is going to 


COSTA 
RICA 


I) Green turtle beach 


lay her own eggs. 


The sea turtle may have to travel over 600 miles, but she is well 
equipped for the journey. Her flippers are like wings. She flies through the 
water. 


Scientists are still learning 
how a sea turtle can find its way 
through the ocean. They think 
the turtles may sense changes in 
Earth’s magnetic field. That may 
help the turtles create a kind of 
mental map. Their memory of 
chemicals or odors in the water 
also may help them find their way. 


Once she returns to her 
birthplace, she finds a mate. A 
few weeks later, she waits until 
it is dark, and then climbs onto the 
beach. 
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The Next Generation 


Out of the water, she struggles to move on land. She crawls to a place where 
high tides will not wash away her eggs. Using her front flippers, she digs a 
wide pit. This will become her nest. With her rear flippers, she scoops out a 
smaller hole inside the pit. 


After two hours of hard work, she is ready to lay more than 100 leathery 
white eggs inside the smaller, deeper hole. She packs sand over them. Then 
she tosses sand over the whole nest. 


During the following two months, she will dig and lay eggs in three 
more nests. After two months, the new hatchlings break out of their shells 
to begin their own journeys. 


Turtles Live On 


After laying all of her eggs, this adult sea turtle once again sets out for 
her feeding grounds off the coast of Florida. Every few years she and other 
adult turtles will return to this beach to lay more eggs. 


Every green sea turtle does this throughout its entire life, which could 
last up to 80 years. Over this time, thousands of baby green sea turtles will 
be born and set out into the open sea. 


Journey into the Sea and Back 


Le Juveniles 


Hatchling 


Laying Eggs 
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Questions The Green Sea Turtle’s 
Journey of a Lifetime 


1. What is the first section “Out From the Sand” about? 
(A) what different sea turtles look like 
how sea turtles learn to swim 
© what sea turtles like to eat 


%* ©) how sea turtles’ eggs hatch 


i. Se il 
2. “One of the baby sea turtles begins to stir and hatch from her egg.” @ 
Write the first two things the hatchling does next. : 
‘ 
® 

D2. 

Pe 
3. When the hatchling reaches the surface of the sand, Q) 
what helps her go the right way? @ 
i 
What can confuse the hatchlings? (9) 

> Correct Answer 
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Ey . 
4. Why is the hatchling’s journey to the water a “race for survival”? 


Use the text to explain your answer. 


CQO©l©O 


5. What is the first thing the hatchling does when she finally gets past 
the breaking waves? 


(@) searches for the other hatchlings 
+ keeps swimming far out to sea 
© rests in the seaweed 


(©) finds food to eat 


6. According to the article, what is one way people have made the sea 
more dangerous for turtles? 


CQO©|©O 


% Correct Answer 
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7. The color of a hatchling’s shell protects it from predators. 


Give a way it is protected from birds. 


Q©|OO® 


Give a way it is protected from sharks. 


8. When does a sea turtle hold its breath for up to 5 hours? 


QO©l©O 


9. What does the article tell you about the feeding habits of an adult 
green sea turtle? 
@) It looks for food under rocks and ledges. 
It swims long distances to find food. 
+ © It goes to the same place every day to eat. 


(©) It uses odors in the water to help it find food. 


+ Correct Answer 


APPENDICES TIMSS & PIRLS 


ZZ International Study Center 364 
PIRLS 2016 INTERNATIONAL RESULTS IN READING Zw IE lynch Schoolaf Education 
Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


( 


50I6 
2016 iP crade 


| 
10. Why does a sea turtle’s body fat become green? @ 
@ 
@ 
a 
11. What information does the article provide about the sea turtle’s size (3) 
and food at each stage of its life? (2) 
Complete the table below. . 
Three have been done for you. 
@) 
Stage of life Size Food 
J The egg has its 
gg | own food. | 
hatchling | 
juvenile dinner plate 
— — —_ — | _ = 
algae and 
adult ce. sea grass 
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12. How old is a female green sea turtle when she first sets out to lay her 


eggs? 

() about 3 years 

about 10 years 
+ ©) about 26 years 
© 


about 80 years 


13. | Which activity in an adult female green sea turtle’s life is not fully 
understood by scientists? 


() how she can swim over 600 miles 
how she makes a nest for her eggs 
© how she avoids being eaten by predators 


* ©) how she finds the right beach to lay her eggs 


>% Correct Answer 


APPENDICES TIMSS & PIRLS 


ZZ International Study Center 366 
PIRLS 2016 INTERNATIONAL RESULTS IN READING 7 IEA Doach Schostot Edacation 


Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


( 


14. 


APPENDICES 


A diagram from the article is shown below. 


What does this diagram help you to understand? 


Hatchling 
BSS Le Juveniles 
Laying Eggs Adult 


We 


OQ©|©O 
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—SESE 
15. How does the writer show you that the green sea turtle is special? 


() by asking you to help to save it 
+ by telling you the amazing things it does 
©) by describing how beautiful it looks 


(0c) by warning you that few turtles are still alive today 


a 
16. The article is divided into sections with headings. 


What does each section tell you about? 
() different dangers sea turtles face 

+ different life stages of a sea turtle 
©) different kinds of sea turtles 


(©) different beliefs about sea turtles 


> Stop 


End of this part of the booklet. 
Please stop working. 


% Correct Answer 


From Turtle Travels by Gary Miller, published 2010 by National Geographic Explorer, Washington D.C. Reprinted 
with permission from National Geographic Society. Illustrations by TIMSS & PIRLS International Study Center, 
Boston College. Images obtained from http://commons.wikimedia.org: Baby Sea Turtle, Green sea turtle near 
Marsa Alam, Green Sea Turtle grazing seagrass, Green sea turtle nesting on beach sand chelonia mydas. 
APPENDICES TIMSS & PIRLS 
PIRLS 2016 INTERNATIONAL RESULTS IN READING LF (PE A nnatlonalSaudy Center” S66 


a 
.\ 
Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


—Z Lynch School of Education 


PIRLS 
2016 GP scrade 
The Green Sea Turtle’s Journey of a Lifetime, Item 2 


2. “One of the baby sea turtles begins to stir and hatch from her egg.” 
Write the first two things the hatchling does next. 


Process: Focus on and Retrieve Explicitly Stated Information 


2 - Complete Comprehension 
The response indicates two of the following: breaking the shell of the egg, getting out 
of the shell, digging/climbing out to the surface, or moving toward the water. 


Examples: 
e Breaking shell 
- She opens the egg. 
- Tears at the shell. 
e Getting out of the shell 
- She breaks out of the egg. 
- Breaks free from shell. 
e Digging out 
- She climbs up and up. 
- She uses her flippers to get out. 
- Digs in the sand. 
- She digs out of the nest. 
e Moving toward the water 


- She goes to the sea. 


1 - Partial Comprehension 
The response gives one of the above points. 


0 - No Comprehension 


The response does not include any of the points listed above, or is vague, unrelated to 
the text, or repeat words in the question. 


Examples: 

- Tears. 

- Climbs. 

- Digs. 

- She swims. 

- She makes a hole. 


- She is alive with motion. 


- Juveniles. 

- Adults. 
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The Green Sea Turtle’s Journey of a Lifetime, Item 3 


3. When the hatchling reaches the surface of the sand, what helps her go 
the right way? 


What can confuse the hatchlings? 
Process: Make Straightforward Inferences 


2 - Complete Comprehension 
The response shows understanding of both parts of the question. 


e Helps: the hatchling is drawn to (moon) light reflecting off the sea/away from 
darkness. 


Examples: 

- Moonlight. 

- Light from the moon. 

- Reflection off the sea. 

- The shiny sea. 

- Moonlight reflecting on the ocean. 
e Confuses: the hatchling is confused by artificial light inland. 

Examples: 

- Street lights. 

- House lights. 

- Lights from people. 

- Car lights. 


1 - Partial Comprehension 


The response shows understanding of one part of the question. 


0 - No Comprehension 
The response does not show understanding of either part of the question. It may be 
vague, unrelated to the text, or repeat words in the question. 

Examples: 

- Sunlight. 

- Light. (not clear if moonlight or street lights) 

- Moon. (does not specify light) 

- Waves. 

- Water. 

- Seeing water. 


- Reflection on the moon 
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The Green Sea Turtle’s Journey of a Lifetime, Item 4 


4. Why is the hatchling’s journey to the water a “race for survival”? 


Use the text to explain your answer. 
Process: Make Straightforward Inferences 


1 - Acceptable Response 
The response indicates the hatchlings have to avoid danger from predators. 
Examples: 


- The crabs and birds and herons will snatch them up. 

- Crabs and birds will kill them. 

- They are likely to be eaten. 

- Because birds can swoop down and eat them. 

- Seagulls and crabs will take them. 

-  Itis arace for survival because sea birds eat sea turtles. 


- Because of the predators/enemies. 


0 - Unacceptable Response 
The response indicates that the hatchlings need to move quickly but not why, refers to 
being eaten by sharks, is vague, unrelated to the text, or repeats words in the question. 
Examples: 
- They have to run really fast. 
- They have to race if they want to survive. (repeats stem) 
- They are no bigger than a walnut. 
- Sharks will eat them. 
- They can be eaten by sharks and fish. 


- There are crabs everywhere. 
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The Green Sea Turtle’s Journey of a Lifetime, Item 6 


6. According to the text, what is one way people have made the sea more dangerous 
for turtles? 


Process: Make Straightforward Inferences 


1 - Acceptable Response 

The response gives one of the points listed below. 
e Plastic. 

e Trash/rubbish/garbage/litter/waste. 

e Pollution. 


e Lights/street lights/car lights. 


0 - Unacceptable Response 
The response refers to other dangers not included in the text. It may be vague, 
unrelated to the text, or repeats words in the question. 

Examples: 

- People stand on them. 

- Hunting. 

- Net fishing. 

- Sharks. 

- Poison. 

- Oil. 


- Chemicals. 
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The Green Sea Turtle’s Journey of a Lifetime, Item 7 
7. The color of a hatchling’s shell protects it from predators. 


Give a way it is protected from birds. 


Give a way it is protected from sharks. 
Process: Interpret and Integrate Ideas and Information 


2 - Complete Comprehension 
The response gives an acceptable response for both protection from birds and 
protection from sharks. 


e Protected from birds: The response recognizes that the dark shell color of the top 
conceals the turtle by blending in with the dark water. 


Examples: 


- The dark color of the top part of the shell blends in with the dark water 
when viewed above. 


- The top half is dark so the turtle blends in with the dark water. 
- Itis the same color as the sea. 

- It blends in with the sea because its shell is black. 

- It camouflages them. 

- It blends into the sea. 

- Her shell is dark so it blends in. 

- Its shell blends in. 


e Protected from sharks: The response recognizes that the light shell color of the 
bottom conceals the turtle by blending in with the sunlight. 


Examples: 
- The bottom is white so sharks may not spot her in the sunlight. 


- The bottom of the shell underneath the turtle is white so a shark that is 
underneath the turtle thinks that the turtle is in the sunlight. 


- Itis the same color as the sunlight. 
- The shell blends into the water. 
- It camouflages itself. 


1 - Partial Comprehension 


The response gives an acceptable response for protection from birds or protection 
from sharks. 
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0 - No Comprehension 


The response does not fully recognize how the shell color conceals the turtle. It may 


give a partial explanation, be vague, unrelated to the text, or repeat words in the 
question. 


e Protected from birds 
Examples: 


- Itis protected from birds with its dark topped shell. 
- It is protected from birds because of its shell. 


- Itcan camouflage itself in the grass. 

- The top half of its shell is green so it blends in with grass and rocks. 
e Protected from sharks 

Examples: 

- The bottom of her shell is white. 

- It is protected from sharks because of its hard shell. 

- It blends in with the sand. 


APPENDICES -o TIMSS & PIRLS 
International Study Center 374 
PIRLS 2016 INTERNATIONAL RESULTS IN READING Gg IE ich cet eien 


Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


PIRLS 
WAU GDP crade 
The Green Sea Turtle’s Journey of a Lifetime, Item 8 


8. When does a sea turtle hold its breath for up to 5 hours? 
Process: Focus on and Retrieve Explicitly Stated Information 


1 - Acceptable Response 
The response indicates sleeping, resting, or at night. 
Examples: 
- To sleep. 
- Rest. 
- At night/at night-time. 


0 - Unacceptable Response 
The response indicates any activity other than those above. It may be vague, unrelated 
to the text, or repeat words in the question. 

Examples: 

- To go under water. 

- When they are juvenile/adult. 

- To get food. 

- Under rocks and ledges. 

- Onland. 

- In danger. 
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The Green Sea Turtle’s Journey of a Lifetime, Item 10 


10. Why does a sea turtle’s body fat become green? 
Process: Focus on and Retrieve Explicitly Stated Information 


1 - Acceptable Response 

The response identifies that it eats green food. 
Examples: 
- Sea grass. 
- The algae and seaweed it eats make it green. 
- It eats seaweed. 
- It eats food that is green. 
- Grass. 


- It eats plants. 


0 - Unacceptable Response 


The response does not identify a reason or is incorrect. It may be vague, unrelated to 
the text, or repeat words in the question. 


Examples: 

- It has green body fat. 

- That is how they get their name. 

- Becomes green from what she eats. 

- It becomes an adult. 

- Its fat is green because it is a green sea turtle. 


- Because it is old. 
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The Green Sea Turtle’s Journey of a Lifetime, Item 11 


11. What information does the article provide about the sea turtle’s size and food at 
each stage of its life? 


Complete the table below. 


Three have been done for you. 


Stage of life Size Food 

Egg The egg has its own food. 
hatchling 

juvenile dinner plate 

adult algae and sea grass 


Process: Interpret and Integrate Ideas and Information 


3 - Extensive Comprehension 


The response correctly completes all 5 spaces. See bold text in the table on the following 
page for responses that are acceptable or not acceptable for each blank space. 


Note to scorers: Do not credit responses that include any incorrect pieces of 
information alongside correct answers. 


2 - Satisfactory Comprehension 

The response correctly completes 4 out of the 5 spaces. 
1 - Minimal Comprehension 

The response correctly completes 3 out of the 5 spaces. 
0 - Unsatisfactory Comprehension 


The response correctly completes 2 or fewer of the spaces. It may be vague, unrelated 
to the text, or repeat words in the question. 
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Stage of life | Size Food 
Egg golf ball The egg has its own food. 
NOT ACCEPTED 
ball 
golf 
Hatchling walnut Shrimp (accept crabs, prawns, shellfish) 
jellyfish 
snails/sea snails 
NOT ACSGEPTED NOT ACCEPTED 
nut plastic 
seaweed or sea grass 
algae 
fish 
Juvenile dinner plate algae 
sea grass/grass/turtle grass or seaweed 
jellyfish 
NOT ACCEPTED 
lawn 
pasture 
fish 
Adult 3 feet algae and sea grass 
300 pounds 
NOT ACCEPTED 
3 
300 
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The Green Sea Turtle’s Journey of a Lifetime, Item 14 


14. A diagram from the article is shown below. 


What does this diagram help you to understand? 
Process: Evaluate and Critique Content and Textual Elements 


1 - Acceptable Response 
The response indicates the life cycle or stages in a turtle’s life. 

Examples: 
- What all the parts of the life cycle are. 
- The different stages in its life. 
- It shows the order of the stages. 
- The (life) cycle of a turtle. 
- The circle of life for turtles. 
- This helps us know how they grow up/develop. 
- What they turn into as they get older. 
- The turtle’s lifetime. 


- The turtles hatch and crawl into the water and come back to lay their eggs. 
(must describe all stages) 


- What parts the sea turtles are going through. 
- Journey of life/life journey/path of life. 
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0 - Unacceptable Response 
The response does not indicate the life cycle or stages in a turtle’s life. It may be vague, 
unrelated to the text, or repeat words in the question. 
Examples: 
- It looks interesting. 
-  Itis about the turtle’s life. 
- How they hatch. (not all the stages) 
- Helps you understand what a turtle does. (too vague) 
- Helps you understand the journey of a sea turtle. 
- How they make their nest. 
- ‘Journey into the Sea and Back.” (need to go beyond title) 
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Flowers 
on the 


Roof 


by Ingibjérg Sigurdardottir 
¢ 


a, ara 
EE oe WA 
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‘ 


hall I tell you about a granny I know? She’s a really strange old lady, and 

so full of life! Her real name is Gunnjona, but I call her Granny Gunn. 

Before she moved into our block of flats she lived in the country. Her 
farmhouse was just like a doll’s house. It had tiny little windows and the roof was 
covered with grass. And there were flowers growing on the roof too! 

Granny Gunn had lived all on her own in the farmhouse but she was never 
lonely because she had many animals to play with: a cow, seven hens, two sheep 
and a cat. 

One day Granny Gunn became ill. 


TIMSS & PIRLS 


APPENDICES Z 
International Study Center 38] 
PIRLS 2016 INTERNATIONAL RESULTS IN READING Zw IE lynch School'of Education 


Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


PIRLS 
WAU ip crace 


“You aren’t seriously ill, but you hs 
should move into town,” the doctor had 9 de 
said. “It’s not very wise to live here all 
alone. Your cow can’t call me if you break 
your leg out in the yard!” 

“I can look after myself!” Granny 
Gunn answered. But then she thought 
that maybe it would be fun to live in 
town. 

“All right!” she said suddenly. “Pll 3 
move to town.” "te NESS 4 on 

Soon she had sold her farm and ‘ = 
bought an apartment in our block of flats. Me 

But what was she going to do about © 
the animals? She couldn’t take them to 
town with her, could she? Luckily, the 
people on the next farm kindly said that 
they would look after them. It was still 
very difficult for Granny Gunn to say 
goodbye to her animal friends. She was (c ~ 
so sad that in the end she decided to take |) __ 
her cat, Robert, with her. 


7 FN. 


Granny Gunn packed all her 
things into a van and was soon on her 
way to her new home. She was very 
excited and really looking forward to 
seeing the town. 

I was very excited, too! I couldn’t 
wait to see who was going to move into 
the apartment opposite ours. Perhaps 
it would be another little boy for me to 
play with. But it was Granny Gunn. 
Still, at least she had a cat. 
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Granny Gunn wasn’t too happy 
when she looked around her new flat. bo x 

“This is just dreadful!” she said. “The OF 
walls are all smooth and white. And just ‘ct 
look at those windows! They’re far too 
big!” She became very quiet. 

“Tm off back home!” she said, and sy 
turned to leave. 

Then she suddenly gave a little 
scream. Robert the cat had jumped out of ~ 
the window! 

“Don’t worry,” I said quickly. “He’s 
only jumped out onto the balcony. Look.” 

Granny Gunn rushed past me onto the balcony. But when she got there, she 
forgot all about Robert. The balcony was huge, and she could see the mountains 
far away and even a bit of the sea. Granny Gunn crouched down so that she 
couldn’t see any of the rooftops—only the mountains and the sky. Granny Gunn 
decided to stay after all. 

But the next day when I went around to help her unpack, she still looked 
very unhappy. 

“Are you upset because all your animals are so far away?” I asked her. 

“I do rather miss them,” she sighed. 


“Then why don’t you go and fetch them?” I asked. Aer, 
Granny Gunn winked at me and For 
gave me a funny grin. p= 


\ There was no one at home when I 
came to visit her the next day. Granny 
Gunn had taken the bus out into the 
country. 

That night I woke up to hear a 
strange cackling sound coming up the 
stairs. What could it be? Of course! 
The hens! They must have been too 
frightened to go in the lift! 

The next morning, I helped Granny 
Gunn feed the hens. 
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“T feel as if ’m back home,” she said. “The hens are cackling all around me, 
and if I squint, I can easily imagine that the mountains I see are those near my 
farm. All that’s missing is the smell of earth and grass.” Suddenly she opened her 
eyes wide and sat up. Granny Gunn had clearly thought of something new. 
“Well now,” she said. “Don’t you think it would be rather nice to have some 
grass on the roof? I think we'll have to go to town tomorrow!” 
And that’s exactly what we did. 


When we got home, Granny Gunn carried the pieces of turf up onto the roof. 
She laid them out carefully, and fixed them so that they wouldn't fall off. 


Ae, 


+ sh re BUheryh a ding A27 Oty, 
2 Mien a x 
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Granny Gunn is much happier now. She’s made a bit of countryside here 
in the town. She’s now as fond of her rooftop garden as she had been of her old 
farm. And there are flowers growing on the roof once more. 

Granny Gunn is not like anyone else I know. She can do anything! There’s 


only one thing that bothers her now. How is she going to get the cow into the 
lift?! 
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Questions Flowers on the Roof 


1. Whois telling the story? 
() a granny 
+ a child 
© a doctor 
©) a farmer 


2. Which of these is most like Granny Gunn’s farmhouse? 


3. Why did the doctor think that Granny Gunn should move 
to town? 


() because she was lonely without her friends 
so she could live with her relatives 
© because she could not take care of her animals 


% (©) incase she needed someone to look after her 


+ Correct Answer 
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4. Who offered to look after Granny Gunn’s animals when she moved 
to town? 
+ () the people on the next farm 


the doctor 


© Granny Gunn’s family 


(©) Robert 


5. Granny Gunn did not like the walls and windows in her new flat. 
Why else was she unhappy? 


(A) She was ill. 
She missed her cat. 
©) She did not like the balcony. 


+ (0c) She felt homesick. 


6. Why did Granny Gunn scream when the cat jumped out of the 
window? 


CLONCIS 


% Correct Answer 
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7. When Granny Gunn was on the balcony, she crouched down so that 
she could not see any of the rooftops—only the mountains and the 
sky. Why did she do this? 


EEE 


Qe©|OO® 


BPO) 
a 
{-\¥ 
> 


of 
8. Find the part of the story by this picture of Granny Gunn: 4 “fx 
Why did Granny Gunn wink and grin at the little boy? 


©, 
f 


Q©|©O 


PC 
9. Write two ways in which Granny Gunn made her new flat feel like 


home. 


1. 


Oe|Oo® 


CA) 2. 
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10. At the end of the story, how did Granny Gunn feel about her new @ 
home? 
© 
@) 
Pe 
11. The last line in the story is: ‘How is she going to get the cow into 
the lift?! 
Why does the story finish with this question? 
+ () to add a joke to the story 
to explain the moral of the story 
© to make the story believable 
(0) to help the reader understand what happened 
——— 
12. What were the little boy’s feelings about Granny Gunn when she 
first moved in and at the end of the story? Use what you have read ® 
to describe each feeling and explain why his feelings changed. @ 
© 
@ 
@) 
% Correct Answer 
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13. Which of the following might you learn from this story? 


() Old people will never be happy if they change where 
they live. 


+ You can make a new place feel like home if you bring 
familiar things with you. 


© You can get used to living with animals, even though 
they are noisy. 


(0) Children and old people do not make good friends. 


-_ Stop 


End of this part of the booklet. 
Please stop working. 


> Correct Answer 


© Flowers on the Roof by Ingibjorg Sigurdardottir, illustrated by Brian Pilkington and published by Mal Og 
Menning (www.malogmenning.is),1985, is reproduced by kind permission of the author. 
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Flowers on the Roof, Item 6 


6. Why did Granny Gunn scream when the cat jumped out of the window? 
Process: Make Straightforward Inferences 


1 - Acceptable Response 
These responses provide an appropriate inference for why Granny screamed. 
Evidence: 


The response demonstrates understanding that Granny did not know there was a balcony 
outside of her window. It may simply state that she did not know this. 


Examples: 

- _ She did not know there was a balcony. 

- Because she thought it was a long drop. 
Or, the response may focus on the fact that she was afraid her cat would be hurt, or could 
die: 

Examples: 

- She thought the cat would fall. 

- She was afraid he would get hurt. 


0 - Unacceptable Response 
These responses do not provide an appropriate inference for why Granny screamed. 
Evidence: 


The response does not demonstrate understanding that Granny did not know there was a 
balcony outside of her window. 


Examples: 

- She thought the cat was going to run away. 
- It made her afraid. 

- She loved her cat. 
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Flowers on the Roof, Item 7 


7. When Granny Gunn was on the balcony, she crouched down so that she could not 
see any of the rooftops - only mountains and the sky. Why did she do this? 


Process: Interpret and Integrate Ideas and Information 


2 - Complete Comprehension 

These responses demonstrate complete comprehension by integrating ideas from across 
the text to interpret Granny’s feelings about the mountains and sky. 

Evidence: 


The response provides a connection between Granny’s view from the balcony and her 
home in the country. It may state that Granny was reminded of her home in the country 
when she saw the mountains and the sky. 


Examples: 
- because they reminded her of the country 


- She could easily imagine that the mountains were those that were near her 
farm. 


- She was thinking about her farm and missing it. 


Or, the response may suggest that Granny could actually see the countryside where she 
had lived. 


Example: 
- because she wanted to see the countryside where she had lived before 
1 - Partial Comprehension 
These responses demonstrate partial comprehension of Granny’s feelings about the 
mountains and the sky. 
Evidence: 


The response accurately describes Granny’s feelings about the view from her balcony, or 
provides an appropriate explanation for why she did this. However, the response does not 
make a connection to her feelings about her home in the country. 


Examples: 

- The mountains were beautiful. 
- so she could see the countryside 
- She didn’t like the rooftops. 
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0 - No Comprehension 


These responses demonstrate no comprehension of Granny’s feelings about the 
mountains and the sky. 


Evidence: 


The response does not accurately describe Granny’s feelings about the view from the 
balcony, and does not make a connection to her feelings about her home in the country, 
or repeats question. 


Examples: 
- because she was tired 
- because she couldn’t see over the rooftops 


- to see only the mountains and the sky (The response repeats question.) 
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Flowers on the Roof, Item 8 


jae 
Zs 


wey 
8. Find the part of the story by this picture of Granny Gunn: .< “A... Why did 
Granny Gunn wink and grin at the little boy? 


Process: Make Straightforward Inferences 


1 - Acceptable Response 
These responses provide an appropriate inference for why Granny winked. 
Evidence: 


The response demonstrates understanding that Granny realized at that point that she 
could bring more of her animals to the city. It may simply state that she had an idea ora 
plan, or that she realizes the little boy had a good idea. 


Examples: 
- Because the child gave her a good idea. 
- She had a plan. 


- She thought it was an unusual idea. (NOTE: “Unusual” is an acceptable 
interpretation of Granny’s reaction to the idea since it does not imply that she 
rejects the idea.) 


Or, the response may simply indicate that Granny agrees with the little boy’s idea. 
Examples: 
- She was thinking yes, I will do that. 
- because she agreed that it was a good plan 

Or, the response may describe that the idea was to bring more of her animals to the city. 
Examples: 
- because she thought she could fetch her animals to town 
- She decided to go get her hens. 

Or, the response may accurately describe the little boy’s idea that prompted her wink and 


grin. 
Examples: 
- because he said, why don’t you go and get your animals 
- because the little boy told her it was okay to bring her animals to town 
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0 - Unacceptable Response 
These responses do not provide an appropriate inference for why Granny winked. 


Evidence: 
The response does not demonstrate understanding that Granny had an idea or plan at 
that point in the story. It may only provide an inaccurate or vague explanation. 
Examples: 
- She liked the little boy. 
- She thought it was a bad idea. 
- because she was happy 


- She decided to put grass on the roof. (NOTE: This is not the idea or plan that 
Granny had when she winked at the child.) 


- as if to say thanks 


APPENDICES TIMSS & PIRLS 


PIRLS 2016 INTERNATIONAL RESULTS IN READING gZ PE A itetnatlonalstucdy Center’ “394 
Lynch School of Education 
Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


( 


PIRLS 
WAU CIDP crade 
Flowers on the Roof, Item 9 


9. Write two ways in which Granny Gunn made her new flat feel like home. 
Process: Focus on and Retrieve Explicitly Stated Information 


2 - Complete Comprehension 


These responses demonstrate complete comprehension of Granny’s actions to make 
her flat feel like home. 


Evidence: 
The response provides any two of the actions taken by Granny listed below. 
Example: 


- Granny Gunn put grass on the rooftop and moved her chickens into the 
apartment. 


- She brought her cat with her and then went to get her farm animals. (NOTE: 
Bringing her cat and bringing her animals are considered two different 
events.) 


1 - Partial Comprehension 


These responses demonstrate partial comprehension of Granny’s actions to make 
her flat feel like home. 


Evidence: 

The response provides only one of the actions taken by Granny listed below. 
Examples: 
- She brought her cat to town. 
- She put some grass and flowers on the roof. 


- She put grass on the roof. She planted flowers on the roof. (Note: Putting grass 
and flowers on the roof are considered a reference to only one event.) 


- She put flowers on the roof and could see the mountains when she crouched 
down. (Note: seeing the mountains is not an appropriate way). 
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0 - No Comprehension 
These responses demonstrate no comprehension of Granny’s actions to make her 
flat feel like home. 


Evidence: 


The response does not provide any of the actions taken by Granny listed below. It 
may describe other actions taken by Granny not related to making her apartment 
feel like home. 


Example: 
- She moved to the city. 


Or, the response may provide only a vague or circular description of her attempt to 
make her apartment feel like home. 


Examples: 
- She tried to make it look like her farm. 
- She brought them back with her. (Please note that “them” is too vague.) 


Actions Taken by Granny to Make Her Apartment Feel Like Home 


NOTE TO SCORERS: More than one example from any individual category is 
only counted as one way Granny made her apartment feel like home. To 
receive credit for “two ways” students must give one example from at least two 
different categories. Students may provide a reasonable paraphrase of these 
actions. 

Actions related to her animals 


- She brought her animals. (Students may or may not mention hens.) 

Actions related to her cat 

- She brought her cat. (This may be considered different from “bringing her 
animals” since the two events occurred at different points in the story.) 

Actions related to her roof 

- She put grass/flowers on the roof. (Both flowers and grass may be mentioned, 


but they are credited as only one action. This may also be phrased as a 
generalization, such as “Made the roof look like it had in the country. ”) 


- She brought the smell of earth. 
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Flowers on the Roof, Item 10 


10. At the end of the story, how did Granny Gunn feel about her new home? 
Process: Make Straightforward Inferences 


1 - Acceptable Response 

These responses provide an appropriate inference of Granny’s feelings at the 
end of the story. 

Evidence: 


The response demonstrates understanding that Granny had a positive feeling 
about her new home at the end of the story. 


Examples: 
- She felt like she was back home. 
- She decided that she liked it after all. 
0 - Unacceptable Response 
These responses do not provide an appropriate inference of Granny’s feelings 
at the end of the story. 
Evidence: 


The response does not demonstrate understanding that Granny had a positive 
feeling about her new home at the end of the story. It may provide only 
inaccurate information. 


Examples: 

- She doesn’t like it. 

- She felt homesick. 

- unhappy because she missed her animals 
Or, the response may describe other aspects of the story without accurately 
describing Granny’s feelings. 

Example: 


- She put grass on the roof. 
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Flowers on the Roof, Item 12 


12. What were the little boy’s feelings about Granny Gunn when she first moved in 
and at the end of the story? Use what you have read to describe each feeling and 
explain why his feelings changed. 


Process: Interpret and Integrate Ideas and Information 


NOTE TO SCORERS: Responses may describe the little boy’s feelings about or 
impressions of Granny Gunn. Also, feelings about Granny Gunn before she moved in 
(e.g., excited) are not appropriate for a feeling when she moved in. 


3 - Extensive Comprehension 


These responses demonstrate extensive comprehension by integrating ideas from across 
the text to interpret the little boy’s feelings about Granny Gunn when she first moved in 
and at the end of the story, as well as why his feelings about her changed. 


Evidence: 


The response describes the little boy’s negative feelings when Granny Gunn first moved 
in and the positive feelings he had at the end of the story. In addition, the response 
explains why his feelings changed using appropriate and specific information from the 
story. Often, his feeling at the end will be implied through the explanation for why his 
earlier feelings changed. 


Examples: 


- At first, he didn’t like the idea of a Granny living in the opposite apartment. He 
started to like Granny when he saw how much fun it was to have animals 
around. 


Or, the response describes the child’s plausible feelings of empathy for Granny Gunn 
when she first moved in and at the end of the story, rather than feelings about her, and 
explains why his feelings changed. 


- At first he was sad for Granny Gunn because she missed her animals, but then 
he was happy because she was happy. His feelings changed because she brought 
her animals and he saw that she was no longer homesick. [Note that the little 
boy’s feelings of empathy are plausible given the story events. The reason for 
the change of feelings also is provided. ] 
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2 - Satisfactory Comprehension 


These responses demonstrate satisfactory comprehension of the little boy’s feelings about 
Granny Gunn and why they changed. 


Evidence: 


The response describes the little boy’s negative feelings when Granny Gunn first moved 
in and the positive feelings he had at the end of the story. However, it does not explain 
why his feelings changed or may include only a vague or general reason for the change. 


Examples: 

- He was disappointed that children weren’t moving in but in the end he liked 
her. 

- At first he was excited because he thought children were moving in. Then he 
was sad because it was Granny. At the end he was happy. 


- He was sad she was moving in but then he liked her because he got to know her. 
[“got to know her” is a vague explanation for why his feelings changed] 


Or, the response describes one of his feelings (his negative feelings about Granny Gunn 
when she first moved in OR his positive feelings about her at the end of the story) and 
explains why his feelings changed. The response does not demonstrate understanding of 
the progression of negative to positive feelings. Often, these responses will describe and 
explain his feelings at the end only. 


- He thought she could do anything because she had made her new home like her 
farm. 


- Heliked her at the end of the story because she was happier with her new home. 


- The little boy was disappointed because he was hoping that kids would move in, 
but his opinion changed because he saw that she could do anything. 


1 - Limited Comprehension 
These responses demonstrate limited comprehension of the little boy’s feelings. 
Evidence: 


The response describes his negative feelings about Granny Gunn when she first moved in 
OR his positive feelings about her at the end of the story. 


Examples: 
- He was disappointed when she moved in. 
- At the end, he really liked her. 


- At the beginning of the story the little boy thinks Granny is a strange old lady. 
Later in the book he says “She can do anything.” (NOTE: first part of the 
response is inaccurate but the response conveys understanding of a positive 
impression of Granny at the end of the story) 
Or, the response explains why his feelings changed but does not describe either feeling. 


- He saw she could do anything. 
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0 - Unsatisfactory Comprehension 


These responses demonstrate unsatisfactory comprehension of the little boy’s feelings. 
Evidence: 


The response does not provide an accurate description of the little boy’s feelings when 
Granny Gunn first moved in or at the end of the story, or explain why his feelings 
changed. Or, a feeling is named, but the response does not indicate if it is a feeling about 
Granny Gunn when she first moved in or at the end of the story. 


- The little boy first thought Granny was strange. 
- The little boy felt bad for her. 


- He was happy. (NOTE: no association of the feeling with either part of the 
story) 
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“The Pear 


By Mary Joslin 
Illustrated by Meile So 


Down by the sea, the 
children used to play 
together. Rich or poor, 
they all joined in the same 
games. 


One day, they went 
diving in the deeper water. 


“Look!” cried a boy. “Look 
what I’ve found!” 


“It’s a pearl,” said 
another. “It’s beautiful.” 

The children gathered 
round to look. They were 
all eager to touch it, as they 


could see how perfect and 
gleaming it was. But who 
would dare to ask the one 
big question ... 
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1. Where does the boy find the pearl? 
() on the beach 
beside the sea 


© where they played games 
* ©) in the deeper water 


~ 9. Why are the children all eager to touch the pearl? 
@) They want to take it away. 
+ They think it is special. 
© They think the boy will drop it. 
(©) They do not believe it is real. 


>» Correct Answer 
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“Can I have it? Please. It’s so lovely.” It was a boy who 


spoke first. 


“It really belongs to Josh. He found it,” said one of the 
girls. 


“You can have it, Reuben,” said Josh, “because you 
really like it.” 


From that day on, the 
other children saw less of 
Reuben. While they played 
outdoors, he stayed inside, 
reading about pearls. He 
learned how pearls grow 
inside oysters, a kind of 
shellfish that lives in the 
sea. 


When his family asked 
him what he wanted for a 
present, he always asked 
for a pearl. “I shall bea 
pearl merchant when I 


erow up,” he said. 
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3. Why does the girl say the pearl really belongs to @ 
Josh? ©) 
© 
4. Why does Josh say Reuben can have the pearl? @ 
©) 
A 
. 
5. What does Reuben do differently after he gets the @) 
pearl? © 
© 
Write two things. 
©) 
iE 
2. 
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And so he was. He left the seaside town that had been 


his home, waving goodbye to his childhood friends. 


He travelled to the great city, where pearls were 
bought and sold. 


He traded some of his smaller pearls for larger, 
finer ones. 


He travelled to the 
ocean shore, where 


fishermen unloaded their 
nets, and he searched 
the oyster shells for new 


pearls. Now and then, he 

found one that was round 

and good. 
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————=s| 
6. Where does Reuben go when he leaves? @ 
1 
© 
Pe : . . 
7. Why does Reuben look for fishermen unloading their 
nets? 
(@) He wants to buy fresh fish. 
He wants to go in their fishing boats. 
© He wants to trade his small pearls. 
+ ©) He wants to find pearls in oyster shells. 
>% Correct Answer 
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Reuben travelled to the lands where pear! fishers went 
diving in the sea for the finest pearls — some silvery pale, 


others glowing rosy pink. 


He became a 
wealthy man. Other 
merchants would 
travel anywhere in the 


world to meet him and 
trade their pearls. 


But although 
Reuben was rich, 
he was not happy. 
He thought more 
and more about the 
seaside town where 
he played as a child. 
He thought about his 
friend Josh, and how 
generous he had been 


in giving Reuben his 


first pearl. 
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8. How do the pearl fishers find the finest pearls? 
* (©) They dive for them in the sea. 
They buy them from a merchant. 


© They search for them in seaside towns. 


(©) They travel far away for them. 


9. How does Reuben become a wealthy man? 


CQe©/©O 


10. Why does Reuben think Josh is generous? 
() because Josh played with Reuben as a child 
because Josh waved goodbye when Reuben left 
* © because Josh gave Reuben a beautiful pearl 
(©) because Josh still lived in the town by the sea 


+ Correct Answer 
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He travelled back to the place where he grew up. 


“Reuben!” called a voice. “It’s good to see you.” There 
was Josh, playing with his own children down by the sea. 


Josh and Reuben sat and talked for hours, just as if 
Reuben had never been away. 


“lve had enough of the city, and of buying and selling,” 
said Reuben. “What I really want to do is move back here 
and live in peace. And I want to give you something back, 
in return for your generosity all those years ago. What 
would you like? A new house? A shiny big boat?” 
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11. Joshis pleased that Reuben has come back. What 
does Josh do that shows this? 


Oe|@O 


19. Why does Reuben want to move back? 
* ©) He wants to live in peace. 
He wants to find more pearls. 
© He wants to see his old house. 


(©) He wants to buy a big boat. 


13 


Reuben offers to give Josh two things. What are 
they? 


1. 
2. 


O@|CO®8 


+ Correct Answer 
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“Thank you,” said Josh. 

“But I love my simple life 
here and I don’t need a new 
house or a boat. I think the 
best thing we can do with 
your money is to share it 
with everyone. Then we can 
all carry on enjoying our 
lives.” 


Reuben was amazed that 
Josh didn’t want anything 
for himself. But then he 
remembered that great 


riches had not made him 
happy, and he smiled. 


“Then that is what we will 
do,” he said. 
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14. What does Josh say they should do with Reuben’s 
money? 


() get a new house 
buy lots of pearls 

* © share it with everyone 
(©) take it back to the city 


> Think about the whole story. 


15. In the story, Josh is a good person. Write two things 


@) 
that Josh does that show he is a good person. @ 
©) 
dy 
—__ 82 WS Ae ee a eNOS (9) 
2. 
G Stop 
End of this part of the booklet. 
Please stop working. 
>% Correct Answer 
From The Merchant Enticed by the Pearl of Great Price by Mary Joslin, illustrations by Meilo So, published 2001 by Lion’s 
Children’s Books, Oxford. Every effort has been made to obtain copyright permission. 
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The Pearl, Item 3 
3. Why does the girl say the pearl really belongs to Josh? 


Process: Focus on and Retrieve Explicitly Stated Information 


1 - Acceptable Response 

The response identifies that Josh found the pearl. 
Example: 
- He found it. 


0 - Unacceptable Response 


The response does not identify that Josh found the pearl. It may be vague, unrelated to 
the text, or repeat words in the question. 


The Pearl, Item 4 
4. Why does Josh say Reuben can have the pearl? 


Process: Focus on and Retrieve Explicitly Stated Information 


1 - Acceptable Response 
The response identifies that Reuben really likes the pearl. 
Examples: 
- Because he really likes it. 
- Because you really like it. 
- He loves it. 
0 - Unacceptable Response 
The response does not identify that Reuben really likes the pearl. It may be vague, 
unrelated to the text, or repeat words in the question. 
Example: 


- He wants it. 
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The Pearl, Item 5 


5. What does Reuben do differently after he gets the pearl? 
Write two things. 


Process: Make Straightforward Inferences 


2 - Complete Comprehension 

The response identifies two things that Reuben does from the following list: 
e No longer plays with his friends/stays indoors. 

e Reads/learns about pearls. 

e Reads/learns about oysters/shellfish. 

e Asks for pearls as a present/wants to have more pearls. 


e Wants to become a pearl merchant. 


1 - Partial Comprehension 


The response identifies one of Reuben’s actions. 


0 - No Comprehension 


The response does not identify any of Reuben’s actions. It may be vague, unrelated to 
the text, or repeat words in the question. 


The Pearl, Item 6 


6. Where does Reuben go when he leaves? 
Process: Focus on and Retrieve Explicitly Stated Information 


1 - Acceptable Response 

The response identifies that Reuben goes to the (great) city. Also accept responses that 
identify the ocean shore or other countries. 

0 - Unacceptable Response 


The response does not identify that Reuben goes to the (great) city, the ocean shore, or 
other countries. It may be vague, unrelated to the text, or repeat words in the question. 
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The Pearl, Item 9 


9. How does Reuben become a wealthy man? 
Process: Interpret and Integrate Ideas and Information 


1 - Acceptable Response 


The response shows understanding that buying/selling/finding/collecting pearls makes 
Reuben a wealthy man. 


Examples: 

- He gets lots of pearls from all over the world. 
- Bytrading and selling pearls. 

- By collecting pearls. 

- He is a pearl merchant. 

- People give him money for his pearls. 


- Other merchants would travel anywhere in the world to meet him and trade 
their pearls. 


0 - Unacceptable Response 


The response does not show understanding that buying/selling/finding/collecting pearls 
makes Reuben a wealthy man. It may mention pearls or wealth, but without making the 
link between them. It may be vague, unrelated to the text, or repeat words in the 


question. 
Examples: 
- He gets rich. 
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The Pearl, Item 11 


11. Josh is pleased that Reuben has come back. What does Josh do that shows this? 
Process: Make Straightforward Inferences 


1 - Acceptable Response 

The response identifies one piece of evidence that Josh is pleased to see Reuben. 
Examples: 
- Hesays, “It’s good to see you.” 
- They talk for hours. 

0 - Unacceptable Response 


The response does not identify why Josh is pleased to see Reuben. It may be vague, 
unrelated to the text, or repeat words in the question. 


Examples: 
- He is playing with his children. 
- He has had enough of the city. 


- He wants to move back. 


The Pearl, Item 13 


13. Reuben offers to give Josh two things. What are they? 
Process: Focus on and Retrieve Explicitly Stated Information 


2 - Complete Comprehension 
The response identifies both of the things that Reuben offers: 
e (New) house. 


e (Shiny big) boat. 


1 - Partial Comprehension 


The response identifies one of Reuben’s offers. 


0 - No Comprehension 


The response does not identify either of Reuben’s offers. It may be vague, unrelated to 
the text, or repeat words in the question. 
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The Pearl, Item 15 
15. Think about the whole story. 


In the story, Josh is a good person. 
Write two things that Josh does that show he is a good person. 


Process: Interpret and Integrate Ideas and Information 


2 - Complete Comprehension 

The response shows understanding of at least two of Josh’s actions: 
e Gives away the pearl at the beginning. 

e Does not want expensive presents for himself. 

e Welcomes his friend back. 


e Wants Reuben to share the money with everyone. 


1 - Partial Comprehension 


The response shows understanding of one of the points above. It may refer twice to the 
same action. 


0 - No Comprehension 
The response does not show understanding of Josh’s actions. It may be vague, 
unrelated to the text, or repeat words in the question. 

Example: 

- He is kind. 

- He is not selfish. 
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African Rhinos 
and Oxpecker 


Rhinos and Oxpeckers Help Each Other 


Rhinos and oxpeckers are animals that are very different 
from each other. The rhinoceros is a very large land 
animal. Only the elephant is larger. The oxpecker bird is 
very tiny. 


Rhinos and oxpeckers live together and help each other. 
The oxpeckers live on the backs of rhinos. 
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1. Where do you find oxpeckers? 


©Qe©(©O 


2. What does the picture in the big red circle help you 
understand? 


() how oxpeckers fly 
what oxpeckers sound like 
© an oxpecker’s nest 


* (©) what oxpeckers look like 


~ 3. Why does the writer tell you about the elephant? 
(@) to show that elephants live near rhinos 
+ to show that the rhino is very big 
© to show that elephants have oxpeckers 


(©) to show that rhinos and elephants eat the same 
food 


+ Correct Answer 
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The chart below shows some facts about rhinos and oxpeckers. 


RHINOCEROS OXPECKER 


Color: Gray Color: Brown 

Weight: 8,000 pounds Weight: 2 ounces 
Height: 6 feet Height: 8 inches 
Food: Grass and leaves Food: Insects and ticks 


Rhinos 


Rhinos are most famous for 
their large horns. In fact, 
the name rhinoceros means 
“nose horn.” Some people 
believe the horn is valuable 
as medicine, but this is 

not true. 


Still, rhinos are in great 
danger from hunters. Even 
though rhinos are protected 
by law from being killed, 
they are still hunted for 
their horns. 
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4. Look at the chart. 
How much does an oxpecker weigh? 


Qe©|©O 


5. What is the height of a rhino? 


QE©|©O 


6. Why do hunters want to kill rhinos? 
@) Rhinos are too dangerous. 
Hunters want rhino meat. 

* © Hunters want rhino horns. 


(©) There are too many rhinos. 


> Correct Answer 
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Rhinos like to eat grass and leaves off trees and bushes. 


However, they can eat all sorts of plants depending on 
what they can find. 


A tick is a tiny creature that sucks the blood of animals. 
Ticks like to hide in trees and bushes so that they can 
climb onto people and animals that pass by. While the 
rhinos are eating, the ticks living in the trees and bushes 
jump onto the rhinos and then live in the rhino’s skin. 


APPENDICES 
PIRLS 2016 INTERNATIONAL RESULTS IN READING 
Downloaded from http://pirls2016.org/download-center/ 


TIMSS & PIRLS 
Zw ] E International Study Center 423 
ww Lynch School of Education 
BOSTON COLLEGE 


( 


PIRLS 
WAU Ci crade 


aaa 
7. What do rhinos eat? @ 
@ 
© 
Fe 
8. Why are trees and bushes a good place for ticks to 
hide? 
() because ticks eat grass and leaves 
+ because rhinos come there to eat 
©) because the birds want to eat the ticks 
(©) because the leaves protect their skin 
% Correct Answer 
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The ticks bite the rhino, fill themselves up with the 
rhino’s blood, and make the rhino very itchy. Rhinos have 
very thick skin that may look tough, but their skin is very 


sensitive. Rhinos spend a lot of time scratching on trees 
and rocks trying to get rid of their ticks. 


Ticks are very small, but they 
need blood to live. A tick attaches 
itself to the skin of an animal and 
sucks blood. There are hundreds 
of kinds of ticks on the planet, 
and they can be found almost 
everywhere. 
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Explain why ticks are a problem for rhinos. 


9 


Q©|©OO® 


10. What do ticks need to live? 
() trees 


rhinos 
© bushes 


* ©) blood 


11. What do rhinos do when they are trying to get rid of 
their ticks? 


OQE©|©OO 


>» Correct Answer 
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Oxpeckers 


The oxpecker is a small brown bird with a wide bill, stiff 
tail, and sharp claws. The oxpeckers sit on the rhino’s back 
and feed on the many ticks that live in the rhino’s skin. 


Oxpeckers eat insects, but their favorite food is blood so 
they prefer the ticks that are full of the rhino’s blood. An 
oxpecker can eat as many as 100 of these bloated ticks in 
a day. 
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12. What are these parts of a oxpecker like? 


@p)Its tail is 
@)Its claws are 


Q©|OO® 


~ 13. Why do oxpeckers especially like to eat ticks? 

* () because the ticks have been sucking blood 
because there are many ticks on each rhino 

©) because the ticks have been eating leaves 


(©) because the ticks are tiny and easy to eat 


=| 
= 


How many bloated ticks can an oxpecker bird eat in 
a day? 


OQe©/©O 


>% Correct Answer 
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Depending on Each Other 


The rhinos and the oxpeckers help each other. The 
oxpeckers get their food, and the rhinos have the ticks 
cleaned away. 


The oxpecker also helps keep the rhino safe from its 
enemies. Rhinos cannot see far and have a hard time 
spotting enemies. The sharp-eyed oxpeckers stand guard 
and warn the rhinos of danger by making loud noises 
and hissing. 
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Pe 
15. Why does the oxpecker know there is danger when 
the rhino does not? 
@) It can hear better. 
+ It can see better. 
© It can fly. 
(©) It can move faster. 
Pe . 
16. What does the oxpecker do to warn the rhino @ 
of danger? © 
© 
> Correct Answer 
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> Think about the whole article. 


17. What would life be like for the oxpeckers if there 
were no rhinos? 


Qe©|OO® 


What would life be like for the rhinos if there were 
no oxpeckers? 


Text by TIMSS & PIRLS International Study Center, Boston College. Images obtained from http://commons.wikimedia.org: 
Sabi 2012 05 18 0439 (7375029620), White rhinoceros head - Sofia zoo — 2, Sabi 2012 05 19 0652 (7189805715), Amblyomma- 
variegatum-male, Red billed oxpecker close, Sabi 2012 05 19 0644 (7375046118). 
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African Rhinos and Oxpecker Birds, Item 1 
1. Where do you find oxpeckers? 


Process: Focus on and Retrieve Explicitly Stated Information 


1 - Acceptable Response 

The response recognizes that oxpeckers are found on (the backs of) rhinos. 
Examples: 
- They live on the backs of rhinos. 
- Onrhinos. 

Also accept responses that identify that oxpeckers are found in Africa. 

0 - Unacceptable Response 


The response does not recognize that oxpeckers are found on the backs of rhinos or in 
Africa. It may give a partial response, be vague, unrelated to the text, or repeat words 
in the question. 


Example: 
- On its back. 


African Rhinos and Oxpecker Birds, Item 4 


4. Look at the chart. How much does an oxpecker weigh? 
Process: Focus on and Retrieve Explicitly Stated Information 


1 - Acceptable Response 


The response recognizes that an oxpecker weighs 2 ounces. It must include an 
indication of the unit of measurement. 


0 - Unacceptable Response 


The response does not recognize that an oxpecker weighs 2 ounces. 


Example: 
- 2, 
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African Rhinos and Oxpecker Birds, Item 5 
5. What is the height of a rhino? 


Process: Focus on and Retrieve Explicitly Stated Information 


1 - Acceptable Response 


The response recognizes that the height of a rhino is 6 feet. It must include an 
indication of the unit of measurement. 


0 - Unacceptable Response 


The response does not recognize that the height of a rhino is 6 feet. 


African Rhinos and Oxpecker Birds, Item 7 


7. What do rhinos eat? 
Process: Focus on and Retrieve Explicitly Stated Information 


1 - Acceptable Response 


The response recognizes that rhinos eat at least one of the following: 
grass/leaves/trees/bushes/plants. Acceptable responses should not include any incorrect 


answers. 


0 - Unacceptable Response 


The response does not recognize that rhinos eat grass/leaves/trees/bushes/plants. It may 
be vague, unrelated to the text, or repeat words in the question. 


Example: 
- Ticks. 
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African Rhinos and Oxpecker Birds, Item 9 


9. Explain why ticks are a problem for rhinos. 
Process: Make Straightforward Inferences 


2 - Complete Comprehension 


The response shows a complete understanding of why ticks are a problem for rhinos by 
including two of the following points: 


e Ticks bite rhinos/suck their blood. 
e This makes the rhinos feel itchy/uncomfortable. 
e They have sensitive skin. 
Examples: 
- The ticks suck the rhinos’ blood and make the rhinos feel itchy. 


- Rhinos have sensitive skin and don’t like the ticks biting them. 
1 - Partial Comprehension 


The response shows a partial understanding of why ticks are a problem for rhinos by 
giving just one of the points above. 

Examples: 

- They suck the rhinos’ blood. 

- Rhinos get itchy. 


0 - No Comprehension 


The response does not show understanding of why ticks are a problem for rhinos. It 
may be vague, unrelated to the text, or repeat words in the question. 


Example: 
- Their skin is tough. 
APPENDICES Z TIMSS & PIRLS é 
International Study Center 434 
PIRLS 2016 INTERNATIONAL RESULTS IN READING wm IEA eee ee 


Downloaded from http://pirls2016.org/download-center/ BOSTON COLLEGE 


PIRLS 
WAU CIDP crade 
African Rhinos and Oxpecker Birds, Item 11 


11. What do rhinos do when they are trying to get rid of their ticks? 
Process: Focus on and Retrieve Explicitly Stated Information 


1 - Acceptable Response 


The response recognizes that rhinos scratch (on trees/rocks) to try to get rid of their 
ticks. 


Examples: 
- They spend a lot of time scratching. 
- Scratch. 
- Rub themselves on trees. 
0 - Unacceptable Response 


The response does not recognize that rhinos scratch (on trees/rocks) to try to get rid of 
their ticks. It may be vague, unrelated to the text, or repeat words in the question. 


African Rhinos and Oxpecker Birds, Item 12 
12. What are these parts of an oxpecker like? 


Its tail is 


Its claws are 


Process: Focus on and Retrieve Explicitly Stated Information 


2 - Complete Comprehension 


The response answers both parts of the question correctly. Appropriate synonyms (e.g. 
rigid/firm and pointy) are also acceptable. 


e Its tail is stiff. 


e Its claws are sharp. 


1 - Partial Comprehension 


The response answers just one part of the question correctly. 


0 - No Comprehension 


The response does not answer either part of the question correctly. It may be vague, 
unrelated to the text, or repeat words in the question. 
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African Rhinos and Oxpecker Birds, Item 14 
14. How many bloated ticks can an oxpecker bird eat in a day? 
Process: Focus on and Retrieve Explicitly Stated Information 
1 - Acceptable Response 
The response recognizes that oxpecker birds eat 100 ticks in a day. 


0 - Unacceptable Response 


The response does not recognize that oxpecker birds eat 100 ticks in a day. 


African Rhinos and Oxpecker Birds, Item 16 

16. What does the oxpecker do to warn the rhino of danger? 

Process: Focus on and Retrieve Explicitly Stated Information 
1 - Acceptable Response 
The response recognizes that the oxpecker makes a loud noise/hissing. 
0 - Unacceptable Response 


The response does not recognize that the oxpecker makes a loud noise/hissing. 
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African Rhinos and Oxpecker Birds, Item 17 
17. Think about the whole article. 


What would life be like for the oxpeckers if there were no rhinos? 


What would life be like for the rhinos if there were no oxpeckers? 


Process: Interpret and Integrate Ideas and Information 


2 - Complete Comprehension 
The response gives an appropriate answer to both parts of the question. 
e What would life be like for the oxpeckers if there were no rhinos? 


The response shows understanding that the oxpeckers would find it harder to get food 
without the ticks on the rhinos. 


Examples: 
- They would have to eat insects. 
- They would not be able to eat rhino blood. 
- They would not be able to eat ticks. 
- It would be hard to find food. 
e What would life be like for the rhinos if there were no oxpeckers? 
The response shows understanding of one disadvantage the rhino would suffer without 


the oxpecker: either that it would suffer greater discomfort from ticks; or that it would 
be more vulnerable to enemies because of its short-sightedness. 


Examples: 

- They would have lots of ticks. 

- They would be itchy all the time. 
- Their enemies would catch them. 


- Dangerous because they can’t see the enemies. 


1 - Partial Comprehension 
The response answers just one part of the question appropriately. 


0 —- No Comprehension 
The response does not answer either part of the question appropriately. It may be 
vague, unrelated to the text, or repeat words in the question. 


Examples: 
e If there were no rhinos. 


- They would die/starve. (without qualification) 
- They would not have any food. 
e If there were no oxpeckers. 
- Very hard. 
- They would die. (without further explanation) 
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